-- Logs begin at Wed 2022-05-25 15:30:12 UTC, end at Wed 2022-05-25 17:00:39 UTC. -- May 25 16:02:08.990485 dv-cinder-843279-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 16:02:08.998821 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 16:02:08 2022] *** May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: nodename: dv-cinder-843279-2-iscsi May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: machine: x86_64 May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: clock source: unix May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: pcre jit disabled May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: detected number of CPU cores: 4 May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: current working directory: / May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: detected binary path: /usr/bin/uwsgi-core May 25 16:02:09.000859 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: your processes number limit is 47680 May 25 16:02:09.001525 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: your memory page size is 4096 bytes May 25 16:02:09.001525 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: detected max file descriptor number: 2048 May 25 16:02:09.001525 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: lock engine: pthread robust mutexes May 25 16:02:09.001525 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: thunder lock: enabled May 25 16:02:09.001525 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 16:02:09.001525 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 16:02:09.045463 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: Python main interpreter initialized at 0x55a3c81619c0 May 25 16:02:09.045463 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: python threads support enabled May 25 16:02:09.045463 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: your server socket listen backlog is limited to 100 connections May 25 16:02:09.045463 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: your mercy for graceful operations on workers is 90 seconds May 25 16:02:09.045803 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: mapped 403077 bytes (393 KB) for 2 cores May 25 16:02:09.045876 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: *** Operational MODE: preforking *** May 25 16:02:09.046140 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: *** uWSGI is running in multiple interpreter mode *** May 25 16:02:09.046140 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: spawned uWSGI master process (pid: 80434) May 25 16:02:09.046337 dv-cinder-843279-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 16:02:09.046836 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: spawned uWSGI worker 1 (pid: 80440, cores: 1) May 25 16:02:09.048564 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: spawned uWSGI worker 2 (pid: 80441, cores: 1) May 25 16:02:09.048564 dv-cinder-843279-2-iscsi devstack@keystone.service[80434]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 16:02:14.662621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:02:14.662621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: from cryptography.utils import int_from_bytes May 25 16:02:14.663488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:02:14.663488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: from cryptography.utils import int_from_bytes May 25 16:02:14.667893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:02:14.667893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: from cryptography.utils import int_from_bytes May 25 16:02:14.668735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:02:14.668735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: from cryptography.utils import int_from_bytes May 25 16:02:14.712736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:02:14.712923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:02:14.713069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] command line args: [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:02:14.713366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:02:14.713571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ================================================================================ {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:02:14.713805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] admin_token = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.714076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] config_dir = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.714294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.714495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] config_source = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.714716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] debug = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.714845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.716246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.716246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.716506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:02:14.716584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.716662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:02:14.716662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] command line args: [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:02:14.716802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.716872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:02:14.716951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ================================================================================ {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:02:14.717091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_config_append = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] admin_token = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_dir = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] config_dir = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_file = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] config_source = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] debug = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.717870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_config_append = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.718957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_dir = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_file = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.719984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] publish_errors = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.720862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.721908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] standard_threads = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.722936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] use_journal = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] publish_errors = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] use_json = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] use_stderr = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] use_syslog = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.723984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.724108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.724196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.724275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.724378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] standard_threads = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.724461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.724637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.724774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.724886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.724972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.725152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.725286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.725286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] use_journal = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.725447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.725518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] use_json = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.725587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.725662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] use_stderr = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.725809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] use_syslog = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.725944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:02:14.726096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.726953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.727922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.728972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.729989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.730983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.731984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.732961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.733861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.734937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.735920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.736992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.737984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.738905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.739850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740236 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.740883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.741977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.742926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.743945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.744878 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745731 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.745962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.746965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.747912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.external = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.748960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.password = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] auth.token = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749735 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.749904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.external = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.750912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.password = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] auth.token = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.751870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.752960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.753982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.754937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.755936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.756979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.757916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.758940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.759906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.760842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.761872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.762948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.763963 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.764919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.765983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.766995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.767939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.768879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.769943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.770950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.771935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.772927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.773971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.774934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.775959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.776898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.777918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778312 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.778869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.779982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.780901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] role.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.781863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] role.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.782972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.783935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784154 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] role.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] role.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.784946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.785986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.786924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.787912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.788927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.789981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.790898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.791880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.792873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.793365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.793468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.793608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.793693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.793840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.793925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.794875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.connection = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.795995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.796936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.connection = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797897 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.797982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.798909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.799053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.799139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.799244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:02:14.799316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.799527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.799758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.799995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.800226 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.800465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.800696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.800934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.801157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.801395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.801626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:02:14.801793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:02:14.830353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.830638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.830793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.831778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.831975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.832191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.839516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.841039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.867957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.868180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.869093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.869324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.922392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.926993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.973244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.973420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.974048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:14.974295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.039167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.039339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.039502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.039646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.039749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.039876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.040004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.040085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.040203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.040295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.040417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.040497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.064251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.064496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.064663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.064803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.064939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.065865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.066008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.066148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.078713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.078926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.090120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.090335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.090472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.090601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.090726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.090850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80440) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.091808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80441) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 16:02:15.110543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.110724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:02:15.111090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.111270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.111358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:02:15.111435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:02:15.111546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.111771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.111899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.111995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 16:02:15.112073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.112202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.112293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.112484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.112737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.112989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.123352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.123618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.123881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.124005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.124183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.124311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.124481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.124774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.132248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.132859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.135512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.135789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.136361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.136958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.137197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.137322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.137462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.137543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.137741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.137881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.138018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.138100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.138219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.138298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.138581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.138845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.164606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.165070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.166302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.166573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.166776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.167049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.172200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.172521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.172641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.172806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.172951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.173214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.180097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.180375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.180569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.180743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.184905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.185271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.185398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.185553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.185698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.185839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.185962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.186895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.187092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.187256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.205454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.205727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.205853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.206017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.210486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.210696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.214188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.214465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.214592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.214754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.219490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.219937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.223043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.223551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.226941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.227257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.227382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.227530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.227658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.227891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.227978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.228099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.228183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.228301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.228394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.228649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.247363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.247621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.247720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.247902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.247983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.248103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.248185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.248421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.256407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.258096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.258192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.258375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.259850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.260141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.261476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.261753 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.262031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.262315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.262577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.263255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.263536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.263814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.264097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.264376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.276034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.276313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.276642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.276930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.277206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.277481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.277759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.277915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.278176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.278465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.278746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.279028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.279333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.279618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.297441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.298778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.300711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.302082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.304077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.305466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.305662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.307081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.307304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.307579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.307901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.308787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.309075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.309362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.315300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.316828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.316953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.318448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.320216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.320543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.320879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.321199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.322336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.322624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.322905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.323184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.330363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.330641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.331020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.332345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.332636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.333018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.338887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80441) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.339219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.339521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.339792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.340056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.340322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.340609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.340883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80440) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 16:02:15.341174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.341889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.342064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.342187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.342308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.342459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80441) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.342581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.342855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.343135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.343437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.343701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.343963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.344228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.344500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80440) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 16:02:15.381028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3c81619c0 pid: 80441 (default app) May 25 16:02:15.383309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3c81619c0 pid: 80440 (default app) May 25 16:02:15.384286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf6351-c0a9-454f-84ff-6213eca72c98 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:15.384580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf6351-c0a9-454f-84ff-6213eca72c98 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:15.384855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf6351-c0a9-454f-84ff-6213eca72c98 None None] PATH_INFO: `/v3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:15.389229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Wed May 25 16:02:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:23.363148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:23.364020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:23.364020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:23.370938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:23.376503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:23.376935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:23.377026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:23.444471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: INFO dbcounter [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] Registered counter for database keystone May 25 16:02:23.467801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG oslo_db.sqlalchemy.engines [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:02:23.479101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writer thread running {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:02:23.663644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG passlib.handlers.bcrypt [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80441) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 16:02:23.663978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG passlib.handlers.bcrypt [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80441) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 16:02:23.719858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:23.721461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:23.857498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 2/3] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 16:02:23.978326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:24.051990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: INFO dbcounter [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] Registered counter for database keystone May 25 16:02:24.073966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG oslo_db.sqlalchemy.engines [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:02:24.081577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writer thread running {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 16:02:24.202943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce1056-b6ca-421a-941a-160d2c773d87 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:24.208498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:24.209164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:24.209450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:24.209727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:24.218843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:24.269517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 16:02:24.269789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0e665-7bec-4146-a326-b693ec9c316f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:24.280038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1324 bytes} [Wed May 25 16:02:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:02:24.287479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:24.311065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4d0b5-f72c-4f41-b8e4-017f729a0587 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:24.317666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:24.318817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:24.319103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:24.319415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] PATH_INFO: `/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:24.321059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] RBAC: Authorizing `identity:get_project(project_id=e50e9a5bbf7f4ed0b472df8cdb0192de)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:24.486870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 16:02:24.487597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4ffd5-219e-4e81-acd2-f038a0760d8f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:24.492028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 3/5] 10.222.0.45 () {56 vars in 1207 bytes} [Wed May 25 16:02:24 2022] GET /identity/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:26.645299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82807e26-c680-4c5d-8164-6358fcbff537 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:26.645872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82807e26-c680-4c5d-8164-6358fcbff537 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:26.645872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82807e26-c680-4c5d-8164-6358fcbff537 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:26.649995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 3/6] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:26.656871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:26.657606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:26.657746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:26.687256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:26.688774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:26.697383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 16:02:26.719888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82807e26-c680-4c5d-8164-6358fcbff537 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:26.735019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82807e26-c680-4c5d-8164-6358fcbff537 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:26.740181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336dade7-363e-4d3a-9145-341bf4a81f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:26.740849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dade7-363e-4d3a-9145-341bf4a81f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:26.741130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dade7-363e-4d3a-9145-341bf4a81f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:26.741383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336dade7-363e-4d3a-9145-341bf4a81f05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:26.750837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dade7-363e-4d3a-9145-341bf4a81f05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:26.753252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336dade7-363e-4d3a-9145-341bf4a81f05 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:26.763222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1324 bytes} [Wed May 25 16:02:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:02:26.769487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:26.784703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89eaee-dd72-4df2-9ef0-b57c1f38b73b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:26.793927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe3397-c770-4bf1-a64f-b28d3c512152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:26.794822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3397-c770-4bf1-a64f-b28d3c512152 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:26.795109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3397-c770-4bf1-a64f-b28d3c512152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:26.795419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3397-c770-4bf1-a64f-b28d3c512152 admin admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:26.796987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe3397-c770-4bf1-a64f-b28d3c512152 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:26.798859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe3397-c770-4bf1-a64f-b28d3c512152 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:26.800489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 5/9] 10.222.0.45 () {56 vars in 1198 bytes} [Wed May 25 16:02:26 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:29.067788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d31bd-d707-4831-97f2-9588f4f2a3f2 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.068318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4ebe2-8bf5-4b7b-acd5-ebffa0cd19c9 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.068758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d31bd-d707-4831-97f2-9588f4f2a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.068859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4ebe2-8bf5-4b7b-acd5-ebffa0cd19c9 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.068946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d31bd-d707-4831-97f2-9588f4f2a3f2 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.069028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4ebe2-8bf5-4b7b-acd5-ebffa0cd19c9 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.069680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:29.070045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 6/11] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:02:29.075060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.075215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.075405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.075501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.075649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.075751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.092696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:29.093873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:29.115043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG passlib.handlers.bcrypt [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80440) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 16:02:29.115461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG passlib.handlers.bcrypt [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80440) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 16:02:29.161373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:29.162947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:29.176461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 7/12] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:29.199281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.225469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:29.268434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 6/13] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:29.292081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.319701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213298-2b52-493c-880a-c99594eaf3aa None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:29.356472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:29.357143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.357427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.357710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.430935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:29.432492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:29.458113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:29.513974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0cb6d-a07e-4a3f-9c5f-cde9736f46be None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:29.516342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:29.540203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 8/14] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:29.546341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.553629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:29.554774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.555117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.555478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.567987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:29.579219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:29.580202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:29.581042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 7/15] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:02:29.586732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.643547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb05461-bad4-49fb-a018-b6b4705ac456 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:29.666720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:29.680253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:29.681160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.681446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.681729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.685633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb553c6d-9d53-4844-8700-cefb59154197 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:29.691917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:29.693426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:02:29.714126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:29.714985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:29.715817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:02:29.715817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:02:29.715817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:02:29.715817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:29.715817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 9/16] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:02:29.721449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.721940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:29.722613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.722889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.723176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.723936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:29.724245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:29.725934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:29.738056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 8/17] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:29.743481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.770953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:29.823448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89fa0-7609-4796-8f7e-cd965c3d63dc None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:29.842352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0c19-bb20-4b35-bea1-14c46b576ef3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:29.857801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:29.858465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.858741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.859010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.859767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:29.860070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:29.861455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:29.876282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:29.877358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:29.877638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:29.877914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:29.878298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:29.879638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:29.881119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:29.882805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:29.888561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:29.927638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:30.000943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738143e7-beb2-4bc2-b077-feff99b674b7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:30.038691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40ce3c-2a14-4425-befe-670174367987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:30.039567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ce3c-2a14-4425-befe-670174367987 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:30.039859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ce3c-2a14-4425-befe-670174367987 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:30.040135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40ce3c-2a14-4425-befe-670174367987 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:30.041426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ce3c-2a14-4425-befe-670174367987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:30.043358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40ce3c-2a14-4425-befe-670174367987 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:30.045024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:30.051125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:30.153707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:30.161865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b33cfc-f031-4753-88c5-95810bf72c46 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:30.196641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:30.197300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:30.197580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:30.197851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:30.198714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.domain.id=default, user.id=32f50b0a3d2643cab337d0af8f4d09eb) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:30.199061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:30.200581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449258e-b856-47a3-b4b3-b1f899c540ce None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:30.209409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 10/21] 10.222.0.45 () {56 vars in 1322 bytes} [Wed May 25 16:02:30 2022] GET /identity/v3/role_assignments?user.id=32f50b0a3d2643cab337d0af8f4d09eb&scope.domain.id=default&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:32.537714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801603e-6c3e-43a3-8d95-779360bdd0da None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.538245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801603e-6c3e-43a3-8d95-779360bdd0da None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.538245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801603e-6c3e-43a3-8d95-779360bdd0da None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.539637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 12/22] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:32.545936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5b52-de0a-41ce-a041-df30a43eb576 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.546729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5b52-de0a-41ce-a041-df30a43eb576 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.547232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5b52-de0a-41ce-a041-df30a43eb576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.560539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e194a-fa72-49d2-b07a-6e4671ef01bd None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.561065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e194a-fa72-49d2-b07a-6e4671ef01bd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.561511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e194a-fa72-49d2-b07a-6e4671ef01bd None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.563013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 13/23] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:02:32.569578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.570105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.570558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.593361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-42ce5b52-de0a-41ce-a041-df30a43eb576 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:32.597723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-42ce5b52-de0a-41ce-a041-df30a43eb576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:32.598785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:32.602148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:32.728899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 11/24] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:32.730826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d4f16-896f-4226-8700-3c291c4c64cc None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.731330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d4f16-896f-4226-8700-3c291c4c64cc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.734912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d4f16-896f-4226-8700-3c291c4c64cc None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.736441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 12/25] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:32.742104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.742583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.743021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.764515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:32.772138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:32.776556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:32.777529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:32.817850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:32.897549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc911626-f0b3-4573-a397-2e31b8a36304 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:32.934914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 13/27] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:32.936199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:32.940015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:32.940845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:32.941285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:32.941909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:32.962251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:32.964601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:32.978242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:02:32.994625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:32.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:32.996860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:02:32.996860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:02:32.996860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:02:32.996860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:32.996860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 15/28] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:32.997117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:33.095297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fdb5d-db3d-44e9-a774-36fd59297ed7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:33.138664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:33.139513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.139800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.140070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.163790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:33.173985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:33.174810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:33.175690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:33.182191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 14/29] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:33.184755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:33.190324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:33.216645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee462b8-1ee6-4c20-8659-d0c4e7527864 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:33.278411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270df892-0a58-4a31-8f31-5be6b211d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:33.280098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df892-0a58-4a31-8f31-5be6b211d089 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.280597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df892-0a58-4a31-8f31-5be6b211d089 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.281251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df892-0a58-4a31-8f31-5be6b211d089 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.282584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270df892-0a58-4a31-8f31-5be6b211d089 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:33.284556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270df892-0a58-4a31-8f31-5be6b211d089 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:33.306495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:33.330282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6906c27-c281-4f5d-b84f-edc825136e1a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:33.367804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:33.368868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.369400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.369865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.370819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:33.371377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:33.373023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:33.401733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 15/30] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:33.402629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:33.428712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 16/31] 10.222.0.45 () {60 vars in 1131 bytes} [Wed May 25 16:02:32 2022] POST /identity/v3/roles => generated 219 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:33.430703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49ad3-2604-4195-8cad-8d7b32680a4b None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.431233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49ad3-2604-4195-8cad-8d7b32680a4b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.431703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e49ad3-2604-4195-8cad-8d7b32680a4b None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.433443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 17/32] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:33.434463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49ad3-2604-4195-8cad-8d7b32680a4b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:33.538002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6729fd-d55c-4daa-b18f-4c5108d82d64 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:33.584105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:33.584910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.585197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.585523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.586627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:33.586945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:33.588625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c69e8-936f-44b6-9bcb-dd803a8a9820 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:33.595665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:33.601876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 16/33] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:33.603982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.604679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.606046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.626471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:33.628066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:33.712104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e49ad3-2604-4195-8cad-8d7b32680a4b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:33.749915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 17/34] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:33.751111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:33.761746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:33.762772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:33.764191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:33.764875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:33.765849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:33.768842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:33.792174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:33.820527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 18/35] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:02:33 2022] POST /identity/v3/projects => generated 301 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:33.821958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:33.936454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e467c-8724-46bd-88ef-8b147b3b7e58 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:33.999196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:34.010901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.012115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.012400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.012682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.016141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.017661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.019411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 18/36] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:33 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:34.034574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:34.049981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb53bc2-9b4a-406f-bc4c-f3b7b18757f5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:34.102189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac4f61-b6e3-4846-a5c9-0677a2a95b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.103179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4f61-b6e3-4846-a5c9-0677a2a95b1a None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.103638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4f61-b6e3-4846-a5c9-0677a2a95b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.104064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac4f61-b6e3-4846-a5c9-0677a2a95b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.104980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac4f61-b6e3-4846-a5c9-0677a2a95b1a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.106597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac4f61-b6e3-4846-a5c9-0677a2a95b1a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.121874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1131 bytes} [Wed May 25 16:02:33 2022] POST /identity/v3/roles => generated 225 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:34.123339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039dfdd-2363-4c93-8e8f-a761c25f17c4 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.123719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039dfdd-2363-4c93-8e8f-a761c25f17c4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.124005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039dfdd-2363-4c93-8e8f-a761c25f17c4 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.125263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 20/38] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:34.126527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f45d4c-fd9f-4b42-8f49-576324f1e849 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.128686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f45d4c-fd9f-4b42-8f49-576324f1e849 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.129072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f45d4c-fd9f-4b42-8f49-576324f1e849 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.130917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 21/39] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:34.132229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.132512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.132857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.154719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:34.156573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:34.170948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d48bcc-1e59-494e-a677-12ab94774017 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:34.211544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b708-ab17-49e4-968f-c13b3866d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.212300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b708-ab17-49e4-968f-c13b3866d444 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.212539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b708-ab17-49e4-968f-c13b3866d444 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.212806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b708-ab17-49e4-968f-c13b3866d444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.214048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b708-ab17-49e4-968f-c13b3866d444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.215641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b708-ab17-49e4-968f-c13b3866d444 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.216881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:34.217365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 19/40] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:34.218626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.218895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.219214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.237865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:34.239006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:34.241995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 22/41] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:34.242788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:34.312932 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:34.322536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 20/42] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:34.323365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:34.361804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6547-31bd-41de-a977-90ca8b54c5ec None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:34.400534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.401428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.401715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.402047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] PATH_INFO: `/v3/domains/default/users/32f50b0a3d2643cab337d0af8f4d09eb/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.404080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=32f50b0a3d2643cab337d0af8f4d09eb, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.405556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.423912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 23/43] 10.222.0.45 () {58 vars in 1361 bytes} [Wed May 25 16:02:34 2022] PUT /identity/v3/domains/default/users/32f50b0a3d2643cab337d0af8f4d09eb/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:02:34.424761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:34.447890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eaa479-2ecb-462e-98bf-b8993ca61086 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:34.479374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:34.488201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647b69-edea-4cf0-a4b7-9444c623fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.488906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647b69-edea-4cf0-a4b7-9444c623fac3 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.489201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647b69-edea-4cf0-a4b7-9444c623fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.489482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647b69-edea-4cf0-a4b7-9444c623fac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.490257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647b69-edea-4cf0-a4b7-9444c623fac3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.491777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647b69-edea-4cf0-a4b7-9444c623fac3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.548319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce582f5b-46f4-4ab7-ab25-3c904966f753 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:34.603474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.604314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.604594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.604873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.606174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.607890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.609631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 24/44] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:34.617209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:34.624373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 21/45] 10.222.0.45 () {60 vars in 1131 bytes} [Wed May 25 16:02:34 2022] POST /identity/v3/roles => generated 223 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:34.741562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9834-aee0-4574-8662-5f2feedcaeae None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:34.758869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:34.784991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5d486-8610-49d1-9cb7-fc0287fb84a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:34.785709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5d486-8610-49d1-9cb7-fc0287fb84a5 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:34.785998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5d486-8610-49d1-9cb7-fc0287fb84a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:34.786283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5d486-8610-49d1-9cb7-fc0287fb84a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:34.787020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5d486-8610-49d1-9cb7-fc0287fb84a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:34.788594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5d486-8610-49d1-9cb7-fc0287fb84a5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:34.818123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 25/46] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:02:34 2022] POST /identity/v3/projects => generated 312 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:36.649737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fff1c-5efa-4e67-8d4b-a7fa3a214594 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:36.650294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fff1c-5efa-4e67-8d4b-a7fa3a214594 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:36.650294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fff1c-5efa-4e67-8d4b-a7fa3a214594 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:36.651825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 22/47] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:36.657283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:36.657699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:36.657955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:36.675511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:36.676694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:36.744730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 26/48] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:36.767219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fff1c-5efa-4e67-8d4b-a7fa3a214594 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:36.832940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:36.885219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fff1c-5efa-4e67-8d4b-a7fa3a214594 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:36.921698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb69dd-3407-4a39-b47f-bf983505e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:36.922424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb69dd-3407-4a39-b47f-bf983505e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:36.922707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb69dd-3407-4a39-b47f-bf983505e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:36.922958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb69dd-3407-4a39-b47f-bf983505e5b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:36.933715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb69dd-3407-4a39-b47f-bf983505e5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-16cb69dd-3407-4a39-b47f-bf983505e5b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:36.941288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:36.942124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:36.942878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 23/49] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:36.949819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:37.017047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab099-2d86-4c07-a76c-b562133285ae None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.017330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab099-2d86-4c07-a76c-b562133285ae None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.017611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ab099-2d86-4c07-a76c-b562133285ae None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.019050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 24/50] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:37.024102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.024397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.024671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.044455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:37.045986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:37.046495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:37.053209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2538e-d315-4ed6-aca0-e23d4211ba21 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:37.096349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:37.097039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.097339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.097616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.098362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:37.098682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:37.100092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:37.111733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 27/51] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:37.117357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:37.121338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 25/52] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:37.145790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:37.203525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:37.231810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a4636d-0ba4-4ae8-9247-fc27f1d24dc5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:37.257833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f5fbd-d24b-4266-92d6-7854532d563c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:37.267043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:37.267965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.268250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.268530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.269758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:37.271282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:37.273094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 28/53] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:37 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:37.278321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:37.293877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:37.294747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.295037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.295340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.296544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:37.298168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:37.300125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 26/54] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:37.305396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:37.305864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:37.379739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1cbc-4317-4ae9-8141-6d11d7dfd986 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:37.403654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe5145-6b36-47f4-8f32-7187987a6005 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:37.413601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:37.414438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.414727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.414983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.416238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:37.417617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:37.417729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:37.424666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 29/55] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:37.425674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:37.440826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1f3ef-46fe-4ae2-83a8-b371e528c413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:37.441495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f3ef-46fe-4ae2-83a8-b371e528c413 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.441775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f3ef-46fe-4ae2-83a8-b371e528c413 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.442047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f3ef-46fe-4ae2-83a8-b371e528c413 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.442761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1f3ef-46fe-4ae2-83a8-b371e528c413 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:37.444256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1f3ef-46fe-4ae2-83a8-b371e528c413 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:37.475528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 27/56] 10.222.0.45 () {60 vars in 1140 bytes} [Wed May 25 16:02:37 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:37.525594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:37.534070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271e3ef-8c86-43be-97f4-062709792b89 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:37.573399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:37.574083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:37.574365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:37.574638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:37.575522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.domain.id=default, user.id=32f50b0a3d2643cab337d0af8f4d09eb) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:37.575834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:37.577384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777b70d-6354-4780-afd3-24b8f6ffa1fd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:37.585863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 30/57] 10.222.0.45 () {56 vars in 1322 bytes} [Wed May 25 16:02:37 2022] GET /identity/v3/role_assignments?user.id=32f50b0a3d2643cab337d0af8f4d09eb&scope.domain.id=default&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:39.680822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057fb74-c2d3-401e-b798-ca5e2f932e81 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:39.681708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057fb74-c2d3-401e-b798-ca5e2f932e81 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:39.681708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057fb74-c2d3-401e-b798-ca5e2f932e81 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:39.683975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 28/58] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:39.689985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:39.690414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:39.690523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:39.708274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:39.709443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:39.785088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:39.810518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057fb74-c2d3-401e-b798-ca5e2f932e81 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:39.931272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057fb74-c2d3-401e-b798-ca5e2f932e81 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:39.967593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0a86a-985c-4bcb-b3a9-941340b8e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:39.968398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0a86a-985c-4bcb-b3a9-941340b8e236 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:39.968674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0a86a-985c-4bcb-b3a9-941340b8e236 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:39.968948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0a86a-985c-4bcb-b3a9-941340b8e236 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:39.970146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0a86a-985c-4bcb-b3a9-941340b8e236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:39.971668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0a86a-985c-4bcb-b3a9-941340b8e236 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:39.973282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 29/60] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:39.979115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:40.068457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:40.082560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8df7c-24fd-4416-a0e5-3adcdc1d6b02 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:40.119238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d71d23-ddab-4629-94ef-f5b1387462c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:40.119912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71d23-ddab-4629-94ef-f5b1387462c7 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:40.120195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71d23-ddab-4629-94ef-f5b1387462c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:40.120472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d71d23-ddab-4629-94ef-f5b1387462c7 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:40.121196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d71d23-ddab-4629-94ef-f5b1387462c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:40.122692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d71d23-ddab-4629-94ef-f5b1387462c7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:40.154754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:02:39 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:43.354601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17f04-1515-4681-bb14-7af9609e9421 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.355686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17f04-1515-4681-bb14-7af9609e9421 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.356212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe17f04-1515-4681-bb14-7af9609e9421 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.358199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 30/62] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:43.363609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.364503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.364989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.387544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:43.389065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:43.481680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 33/63] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:43.529135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17f04-1515-4681-bb14-7af9609e9421 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:43.577106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:43.670047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe17f04-1515-4681-bb14-7af9609e9421 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:43.721168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd93f3-4145-41d0-9e6b-9b29693dc9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:43.722328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd93f3-4145-41d0-9e6b-9b29693dc9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.722823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd93f3-4145-41d0-9e6b-9b29693dc9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.723305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd93f3-4145-41d0-9e6b-9b29693dc9f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.744066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd93f3-4145-41d0-9e6b-9b29693dc9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-17dd93f3-4145-41d0-9e6b-9b29693dc9f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:43.752070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:43.752972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:43.753716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:43.760079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 31/64] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:43.764367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:43.883902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:43.896302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99f438-0d0f-4417-b64c-e35d3f5deef0 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.896921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99f438-0d0f-4417-b64c-e35d3f5deef0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.897407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99f438-0d0f-4417-b64c-e35d3f5deef0 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.898989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 32/65] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:02:43.904635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9892d59-4443-4f7c-802c-63d6e6e70573 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.906049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9892d59-4443-4f7c-802c-63d6e6e70573 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.906601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9892d59-4443-4f7c-802c-63d6e6e70573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.913880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dce2f-dad2-4b5b-b9c1-71c9cc6517e7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:43.925013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f9892d59-4443-4f7c-802c-63d6e6e70573 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:43.926546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f9892d59-4443-4f7c-802c-63d6e6e70573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:43.955216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:43.956231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.956528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.956815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.957852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:43.958172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:43.959775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fe20c-ea5e-4e54-934e-dabe9dfe79ed None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:43.969512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 34/66] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:43.971067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3561-5abd-44dd-8aa4-dc121538a3a5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:43.971383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3561-5abd-44dd-8aa4-dc121538a3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:43.971658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f3561-5abd-44dd-8aa4-dc121538a3a5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:43.973037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 35/67] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:43.978345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f3561-5abd-44dd-8aa4-dc121538a3a5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.017200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 33/68] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:44.019733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.020020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.020289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.037472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:44.039375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:44.060679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.100077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f3561-5abd-44dd-8aa4-dc121538a3a5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.118008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 34/69] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:44.127323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.151474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1af559-777d-49d8-b692-ec0005ad2e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.152369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af559-777d-49d8-b692-ec0005ad2e4f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.152657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af559-777d-49d8-b692-ec0005ad2e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.152931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1af559-777d-49d8-b692-ec0005ad2e4f None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.156887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.174461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1af559-777d-49d8-b692-ec0005ad2e4f None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.176208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1af559-777d-49d8-b692-ec0005ad2e4f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.183346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 36/70] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:43 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:44.183346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df07a-4e8b-4398-aa8d-ea5cb15e3ab4 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.183346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df07a-4e8b-4398-aa8d-ea5cb15e3ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.183346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df07a-4e8b-4398-aa8d-ea5cb15e3ab4 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.183346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 37/71] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:44.183346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507df07a-4e8b-4398-aa8d-ea5cb15e3ab4 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.232643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efdbd0-02b4-4b41-be14-2badc592a8c7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.266855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.267712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.268017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.268282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.278436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:44.285230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507df07a-4e8b-4398-aa8d-ea5cb15e3ab4 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:44.286139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:44.287031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:44.287822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 35/72] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:44.288648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.304251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.323864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf894b6-4e23-4987-9a5b-334b143580e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.324720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf894b6-4e23-4987-9a5b-334b143580e0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.325059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf894b6-4e23-4987-9a5b-334b143580e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.325335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf894b6-4e23-4987-9a5b-334b143580e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.336656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf894b6-4e23-4987-9a5b-334b143580e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-2bf894b6-4e23-4987-9a5b-334b143580e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:44.345971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:44.347006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:44.347818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 38/73] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:44.348427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028029-5a53-4b0c-89e6-c549af71f7dd None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.348702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028029-5a53-4b0c-89e6-c549af71f7dd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.348980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028029-5a53-4b0c-89e6-c549af71f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.365300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-e0028029-5a53-4b0c-89e6-c549af71f7dd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:44.366474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e0028029-5a53-4b0c-89e6-c549af71f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:44.394620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193dbf4-582c-4ee1-8a5e-18a269382d8c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.415456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.428929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617be6-3cf6-4b8b-ac2f-b9b4f0308385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.429519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617be6-3cf6-4b8b-ac2f-b9b4f0308385 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.429802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617be6-3cf6-4b8b-ac2f-b9b4f0308385 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.430073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617be6-3cf6-4b8b-ac2f-b9b4f0308385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.432725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 39/74] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:44.434050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e25a-ab6f-4717-84ad-accba33cedea None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.434361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e25a-ab6f-4717-84ad-accba33cedea None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.434641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e25a-ab6f-4717-84ad-accba33cedea None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.435940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 40/75] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:44.440121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e25a-ab6f-4717-84ad-accba33cedea None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.505978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617be6-3cf6-4b8b-ac2f-b9b4f0308385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.507502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617be6-3cf6-4b8b-ac2f-b9b4f0308385 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.521619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.540909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e25a-ab6f-4717-84ad-accba33cedea None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.575764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.576434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.576718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.576996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.577744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:44.578052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.579486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.588184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 41/76] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:44.592054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.605505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 36/77] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:44.606900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.607195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.607479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.623571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:44.624803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:44.637334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.694015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1eb5d-4603-4fa1-9481-72fe483d6159 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.698719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 37/78] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:44.699607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.738995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.739696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.739981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.740252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.741004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:44.741310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.742719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.750828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 42/79] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:44.754561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.754661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.810339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd130f3b-7ffd-445b-8a41-d71af87b0827 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.844289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.845096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.845381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.845659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.846846 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.848377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.850002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 38/80] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:44.850179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432beb6-1228-4526-ab8e-c024c900891f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.850765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.859285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.886175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.887061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.887372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.887645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.888834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.890318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.891989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 43/81] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:44.892745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:44.952971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4379d8f-1403-41e3-bbbc-278595f85473 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.969559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:44.992694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:44.993594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:44.993874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:44.994146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:44.995410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:44.995509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baad95d-1b55-4fa2-a3ae-f7ab8b581b5b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:44.996990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:44.998721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 39/82] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:44.999511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.030433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.031273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.031560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.031839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.042207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:45.050597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:45.051574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:45.052547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 44/83] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:45.053306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.093798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.111580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f49f067-a6c0-4588-95aa-2cfafbce0a1a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.146937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.147878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.148288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.148569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.149809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.151321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.152986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 40/84] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:44 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:45.157621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2ef81-4e87-4b12-a39c-1061cf9b7f05 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.158429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.193715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.194513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.194818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.195116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.195864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.197538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.209655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.217906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 45/85] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:02:45 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:45.231430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.268160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50774559-39ac-49d0-b88c-e808b68d6b9d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.309830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.310608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.310923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.311228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.331660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.343796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf100730-b7a7-4d38-a2b3-d1d64fdeb853 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.379419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.380085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.380379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.380660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.381597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=2ed8f18749b54862825a1a3ad3d01a9d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:45.381920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.383476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.390321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 46/86] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/role_assignments?user.id=2ed8f18749b54862825a1a3ad3d01a9d&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=4c771a108e9842478e33bd28c8b41844 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:45.391295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.398320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.399904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.473156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.549031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 41/87] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:45.549626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f313bd-2ad5-49bd-9eea-885ee9aee008 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.549936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.598988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.599724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.600027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.600249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.601693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:45.602009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.604516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.614716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 47/88] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:45.615797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.640491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.695223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54a038-171b-45d2-a86f-704ead0d8c71 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.738895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.740306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.740788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.741347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.747231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9b15a-1b84-447c-95f1-f05a02768536 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.763912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.790144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:45.791208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.791598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.792025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.793848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.797046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.799219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 48/89] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:45.800097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:45.837000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:45.838504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:45.946669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.966280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b0138-3957-4419-b713-29bbd6084813 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:45.999125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 42/90] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:46.000089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:46.018828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:46.019759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:46.020042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:46.020319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:46.022749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:46.024275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:46.027254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 49/91] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:46.028112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:46.099541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:46.186840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de964b9e-d78f-4c97-870a-8547af20e786 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:46.236864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5338ba-4f94-42b4-b110-71c58c01463d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:46.256111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:46.256707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:46.256996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:46.257277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:46.258115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=32f50b0a3d2643cab337d0af8f4d09eb) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:46.258432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:46.259929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:46.270499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 43/92] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:45 2022] GET /identity/v3/role_assignments?user.id=32f50b0a3d2643cab337d0af8f4d09eb&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:46.271143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:46.336145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:46.337823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:46.338120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:46.338402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:46.339826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:46.341430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:46.343283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 50/93] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:46 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:46.350005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:46.410419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:46.522574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832626fa-38d6-46e6-a565-86912997ac23 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:46.543777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:46.565455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab19b86-4cd0-434c-aeca-09ecd2c595d8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:46.580547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:46.581218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:46.581504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:46.581779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:46.627876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:46.628575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:46.628835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:46.629110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:46.629949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] RBAC: Adding query filter params (role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=2ed8f18749b54862825a1a3ad3d01a9d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:46.630287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:46.631902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:46.637711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 51/94] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:46 2022] GET /identity/v3/role_assignments?user.id=2ed8f18749b54862825a1a3ad3d01a9d&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 259 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:46.709558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:46.711076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:46.881911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 44/95] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:46.887609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:46.982674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:46.998285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daabd64-de84-4612-a7be-26e440682c65 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:47.033096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd30997-1429-43a6-89c5-92aaf41c4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:47.033978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30997-1429-43a6-89c5-92aaf41c4427 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:47.034256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30997-1429-43a6-89c5-92aaf41c4427 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:47.034530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd30997-1429-43a6-89c5-92aaf41c4427 None admin] PATH_INFO: `/v3/projects/b3a5e977a6a546bb886f5031008483e4` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:47.035740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd30997-1429-43a6-89c5-92aaf41c4427 None admin] RBAC: Authorizing `identity:get_project(project_id=b3a5e977a6a546bb886f5031008483e4)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:47.037208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd30997-1429-43a6-89c5-92aaf41c4427 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:47.039075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 52/96] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:46 2022] GET /identity/v3/projects/b3a5e977a6a546bb886f5031008483e4 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:47.045317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:47.062205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:47.183875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1ff4f-ebb0-45c2-96e5-bf35efa459bb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:47.237220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:47.237939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:47.238224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:47.238496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:47.239354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=b3a5e977a6a546bb886f5031008483e4, user.id=2ed8f18749b54862825a1a3ad3d01a9d) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:47.239719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:47.241240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14238d-ebed-4b71-8ae7-9dd5dd1b1940 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:47.251543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 45/97] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:47 2022] GET /identity/v3/role_assignments?user.id=2ed8f18749b54862825a1a3ad3d01a9d&scope.project.id=b3a5e977a6a546bb886f5031008483e4&role.id=4c771a108e9842478e33bd28c8b41844 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:48.419353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649fed-1eda-4a75-a240-f63bfae2bdb5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.419852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649fed-1eda-4a75-a240-f63bfae2bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.419852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649fed-1eda-4a75-a240-f63bfae2bdb5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.421447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 53/98] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:48.437382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.437907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.437907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.457823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:48.459022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:48.532427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 46/99] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:48.554834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649fed-1eda-4a75-a240-f63bfae2bdb5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:48.659464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649fed-1eda-4a75-a240-f63bfae2bdb5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:48.694019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d33a3-ca1a-4a77-8069-c810078a29c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:48.694761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d33a3-ca1a-4a77-8069-c810078a29c4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.695030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d33a3-ca1a-4a77-8069-c810078a29c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.695332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d33a3-ca1a-4a77-8069-c810078a29c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.705939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d33a3-ca1a-4a77-8069-c810078a29c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-270d33a3-ca1a-4a77-8069-c810078a29c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:48.713831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:48.714749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:48.715648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 54/100] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:48.723927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:48.732487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:48.772046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6775-6cfd-4def-a713-9678cfdf0ebd None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.772694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6775-6cfd-4def-a713-9678cfdf0ebd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.773165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b6775-6cfd-4def-a713-9678cfdf0ebd None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.774833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 55/101] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:02:48.781755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134d52-452a-410f-a3c9-8f7622da5e53 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.782320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134d52-452a-410f-a3c9-8f7622da5e53 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.782813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134d52-452a-410f-a3c9-8f7622da5e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.821982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b2134d52-452a-410f-a3c9-8f7622da5e53 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:48.823186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b2134d52-452a-410f-a3c9-8f7622da5e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:48.844742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:48.901356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85721e24-05c5-447e-9da1-de3f2272dd92 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:48.958583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 56/102] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:48.959901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35dfd-9dd6-4e36-9f3a-40ba865c4ff6 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.960359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35dfd-9dd6-4e36-9f3a-40ba865c4ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.960775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35dfd-9dd6-4e36-9f3a-40ba865c4ff6 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.962421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 57/103] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:48.968250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.968820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.969238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.979197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:48.983099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:48.983674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:48.984116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:48.985456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:48.989523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:48.991761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.005227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:49.006947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:49.009014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 47/104] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:49.011930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.127576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:49.145308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 58/105] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:49.146014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.188178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39533040-9cba-46b5-912f-4d4df43fa5d2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.224963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7377-0c3f-45fd-bc41-034c2bcc2d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.225711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7377-0c3f-45fd-bc41-034c2bcc2d9b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.225997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7377-0c3f-45fd-bc41-034c2bcc2d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.226379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7377-0c3f-45fd-bc41-034c2bcc2d9b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.237884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7377-0c3f-45fd-bc41-034c2bcc2d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-ddcd7377-0c3f-45fd-bc41-034c2bcc2d9b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:49.246132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:49.247089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:49.247914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 48/106] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:49.249072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27234bc6-7188-4105-83ab-e3ff58f0efd0 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.253943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27234bc6-7188-4105-83ab-e3ff58f0efd0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.253943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27234bc6-7188-4105-83ab-e3ff58f0efd0 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.254118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:49.254188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 49/107] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:49.254188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27234bc6-7188-4105-83ab-e3ff58f0efd0 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.283699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f8de-2753-4466-b6f9-b0b37d68f7ce None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.321019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.322395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.322894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.323413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.324865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:49.326628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.328599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 59/108] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:49.329577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.400775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27234bc6-7188-4105-83ab-e3ff58f0efd0 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.432998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:49.442806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9134b09-a934-4460-b1bb-81f1d4ad6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.443670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134b09-a934-4460-b1bb-81f1d4ad6a15 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.443930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134b09-a934-4460-b1bb-81f1d4ad6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.444207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9134b09-a934-4460-b1bb-81f1d4ad6a15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.445390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9134b09-a934-4460-b1bb-81f1d4ad6a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:49.446853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9134b09-a934-4460-b1bb-81f1d4ad6a15 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.448496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c95f120-2d9b-4d7c-9a88-bd3e748108f6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.448913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 50/109] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:49.449661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.449986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.450265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.467313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:49.468520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:49.488719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.489871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.490345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.490816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.491780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:49.492293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:49.494096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.508746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 60/110] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:49.509882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.513884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:49.540623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 51/111] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:49.541299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.620299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97c588-feaa-4b4f-a7bd-8b09b2fd5ef8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.662733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.664091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.664590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.665096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.666669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:49.668914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.671256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 61/112] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:49.672235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.677390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151417e2-9d28-4969-8727-2883beeaa6a9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.705356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:49.715008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.715754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.716098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.716377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.717157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:49.718631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.749559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 52/113] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:02:49 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:49.750728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.754039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:49.793498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd45787-3a2f-4d47-9eee-cc468d71c0a9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.849109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.851426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.851969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.852435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] PATH_INFO: `/v3/users/3f13ec6103904841954d542b2a63064f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.873675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] RBAC: Authorizing `identity:get_user(user_id=3f13ec6103904841954d542b2a63064f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:49.876453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:49.879873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 62/114] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/users/3f13ec6103904841954d542b2a63064f => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:49.881319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:49.885733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a6f33-6b8a-446a-8e7c-928b579723a4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:49.925035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a13f2b-3f07-4487-aacf-39b492d7d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:49.926014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13f2b-3f07-4487-aacf-39b492d7d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.926361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13f2b-3f07-4487-aacf-39b492d7d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.926945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13f2b-3f07-4487-aacf-39b492d7d3e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.941675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13f2b-3f07-4487-aacf-39b492d7d3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c4a13f2b-3f07-4487-aacf-39b492d7d3e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:49.952114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:49.953167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:49.953992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 53/115] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:49.959242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8303d-3a4a-4114-aec3-468aca79dee3 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:49.959242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8303d-3a4a-4114-aec3-468aca79dee3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:49.959242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8303d-3a4a-4114-aec3-468aca79dee3 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:49.961301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 54/116] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:49.962310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8303d-3a4a-4114-aec3-468aca79dee3 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.012959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.034023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fd68d-6509-47a8-941d-583f90f9f58f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.069517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.083188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaddc25-c190-4dbe-bd15-c1ca10b66bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.083188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaddc25-c190-4dbe-bd15-c1ca10b66bbe None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.083188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaddc25-c190-4dbe-bd15-c1ca10b66bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.083188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaddc25-c190-4dbe-bd15-c1ca10b66bbe None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690/users/2ed8f18749b54862825a1a3ad3d01a9d/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.085282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaddc25-c190-4dbe-bd15-c1ca10b66bbe None admin] RBAC: Authorizing `identity:create_grant(project_id=961fffd1adbf452ab949876aa5822690, user_id=2ed8f18749b54862825a1a3ad3d01a9d, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.087579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaddc25-c190-4dbe-bd15-c1ca10b66bbe None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.097141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8303d-3a4a-4114-aec3-468aca79dee3 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.108415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 63/117] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:02:49 2022] PUT /identity/v3/projects/961fffd1adbf452ab949876aa5822690/users/2ed8f18749b54862825a1a3ad3d01a9d/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:02:50.110502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.110862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.111239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.147902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:50.150461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:50.158389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da28d35-5ea0-42ac-a226-dc2f866fec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.162867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28d35-5ea0-42ac-a226-dc2f866fec97 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.162867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28d35-5ea0-42ac-a226-dc2f866fec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.162867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da28d35-5ea0-42ac-a226-dc2f866fec97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.289478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 64/118] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:50.290492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.296727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da28d35-5ea0-42ac-a226-dc2f866fec97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.298248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da28d35-5ea0-42ac-a226-dc2f866fec97 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.342103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.412087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 55/119] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:50.413680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed7d6-35f4-4c98-a101-bc76b9daffcd None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.414115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed7d6-35f4-4c98-a101-bc76b9daffcd None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.414530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed7d6-35f4-4c98-a101-bc76b9daffcd None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.416005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 56/120] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:50.416821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed7d6-35f4-4c98-a101-bc76b9daffcd None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.420599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2aead-0553-433c-add2-73bd3fdf23ef None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.448537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.468697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.469738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.470110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.470452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.471560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:50.471938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.473803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.488362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 65/121] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:50.489256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.548159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed7d6-35f4-4c98-a101-bc76b9daffcd None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.594217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc6dbf-b0a9-4f30-b703-1229ba32a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.595449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc6dbf-b0a9-4f30-b703-1229ba32a668 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.595800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc6dbf-b0a9-4f30-b703-1229ba32a668 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.596145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc6dbf-b0a9-4f30-b703-1229ba32a668 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.597490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df907f25-3913-4cd6-9724-085bc9e403a4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.604555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.612257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc6dbf-b0a9-4f30-b703-1229ba32a668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-decc6dbf-b0a9-4f30-b703-1229ba32a668 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:50.623348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:50.624197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:50.624929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 57/122] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:50.626439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.626965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.627448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.637336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.638521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.638993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.639463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.640839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.642462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.644561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 66/123] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:50.645503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.654698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:50.656146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:50.702738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.754547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 58/124] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:50.756630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.759212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0105-1983-4d22-943d-99060c3e88f3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.796752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.798030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.798564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.799059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.800463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.802097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.803952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 67/125] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:50.804961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.890568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cd9e0-722d-4552-aeec-48724dff04e5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.908448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbbdc-180a-4d51-b537-fa477491db0d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:50.927621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.929967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:50.940679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.941630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.941920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.942200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.942967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:50.943437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.945464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.949523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:50.950463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:50.950932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:50.951527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:50.952544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] RBAC: Adding query filter params (role.id=d7e8eb03691f4016af76d131e4ce3212, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=3f13ec6103904841954d542b2a63064f) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:50.953067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:50.954704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:50.954995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 59/126] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:50.955942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:50.961787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 68/127] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/role_assignments?user.id=3f13ec6103904841954d542b2a63064f&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=d7e8eb03691f4016af76d131e4ce3212 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:50.963045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.125490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74e093-99dc-4657-85ae-7ec4ccb48ea9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.145209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a5683-f1af-45d1-9c06-f2043c1ec0c2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.185697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.187202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.188010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.188490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.190068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:51.191865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:51.194668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 69/128] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:51.195926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.198791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.200049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.200336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.201565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.232349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:51.244735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:51.245716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:51.246469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:51.248253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 60/129] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:51.249137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.259851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:51.335953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b315a2-1a5e-4c5c-a3ad-3b6ea3b6cbc0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.352183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:51.411598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285f7da-4bc8-4bed-acbc-559ca4c7bb69 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.415929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.416821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.417101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.417372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.418996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:51.428676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:51.435197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 70/130] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:51 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:51.435197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.459655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.461074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.463035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.464334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690/users/32f50b0a3d2643cab337d0af8f4d09eb/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.467454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] RBAC: Authorizing `identity:create_grant(project_id=961fffd1adbf452ab949876aa5822690, user_id=32f50b0a3d2643cab337d0af8f4d09eb, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:51.470304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:51.496900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 61/131] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:02:51 2022] PUT /identity/v3/projects/961fffd1adbf452ab949876aa5822690/users/32f50b0a3d2643cab337d0af8f4d09eb/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:02:51.498278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.651698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5d02-1e0c-4b4f-b98f-98af0c18a9f4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.672933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:51.694082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.694775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.695052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.695363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.696139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:51.696446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:51.698986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:51.709420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 71/132] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:51.717115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.753503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd725707-dda3-4fd5-86f9-363a5fe9cb5e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.774274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:51.836812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32100b29-3371-4347-bc59-9900c817252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.837707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32100b29-3371-4347-bc59-9900c817252a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.837990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32100b29-3371-4347-bc59-9900c817252a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.838265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32100b29-3371-4347-bc59-9900c817252a None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.843977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32100b29-3371-4347-bc59-9900c817252a None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:51.845597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32100b29-3371-4347-bc59-9900c817252a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:51.847443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 62/133] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:51 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:51.847858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833003db-887b-4d8d-96e3-31a405ba9849 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.853424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32100b29-3371-4347-bc59-9900c817252a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.889517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:51.891368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:51.891855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:51.892463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:51.894420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:51.896960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:51.899049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 72/134] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:51 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:51.904874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:51.978802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32100b29-3371-4347-bc59-9900c817252a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:51.989285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:52.019945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:52.021594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.022117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.022590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690/users/2ed8f18749b54862825a1a3ad3d01a9d/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.025644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=961fffd1adbf452ab949876aa5822690, user_id=2ed8f18749b54862825a1a3ad3d01a9d, role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:52.027392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:52.046971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 63/135] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:02:51 2022] PUT /identity/v3/projects/961fffd1adbf452ab949876aa5822690/users/2ed8f18749b54862825a1a3ad3d01a9d/roles/6e9210d695b14e9bb259dbc706a59244 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:02:52.106150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c209bc-9714-44e4-bfe4-510b060a2c9d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:52.155381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e221ad3-f374-4009-92d4-8ea86a2383cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:52.156245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221ad3-f374-4009-92d4-8ea86a2383cd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.156525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221ad3-f374-4009-92d4-8ea86a2383cd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.156800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e221ad3-f374-4009-92d4-8ea86a2383cd None admin] PATH_INFO: `/v3/projects/b3a5e977a6a546bb886f5031008483e4` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.158019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221ad3-f374-4009-92d4-8ea86a2383cd None admin] RBAC: Authorizing `identity:get_project(project_id=b3a5e977a6a546bb886f5031008483e4)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:52.159539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e221ad3-f374-4009-92d4-8ea86a2383cd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:52.161549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 73/136] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:51 2022] GET /identity/v3/projects/b3a5e977a6a546bb886f5031008483e4 => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:52.167341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:52.231735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:52.311811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2010b19-97c4-473f-b547-40afba4359b3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:52.351036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e521e-7a88-4bf7-85ac-c41418a0dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:52.352365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e521e-7a88-4bf7-85ac-c41418a0dbc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.352836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e521e-7a88-4bf7-85ac-c41418a0dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.353294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e521e-7a88-4bf7-85ac-c41418a0dbc2 None admin] PATH_INFO: `/v3/projects/b3a5e977a6a546bb886f5031008483e4/users/2ed8f18749b54862825a1a3ad3d01a9d/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.355848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e521e-7a88-4bf7-85ac-c41418a0dbc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3a5e977a6a546bb886f5031008483e4, user_id=2ed8f18749b54862825a1a3ad3d01a9d, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:52.357711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e521e-7a88-4bf7-85ac-c41418a0dbc2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:52.375071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 64/137] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:02:52 2022] PUT /identity/v3/projects/b3a5e977a6a546bb886f5031008483e4/users/2ed8f18749b54862825a1a3ad3d01a9d/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:02:52.719341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d69e49-d03b-4ba3-a46c-a3d5eb1a1367 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.719898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d69e49-d03b-4ba3-a46c-a3d5eb1a1367 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.719898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d69e49-d03b-4ba3-a46c-a3d5eb1a1367 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.721553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 74/138] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:52.727995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959639-9103-4f19-a84e-c92d6610ac48 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.728616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959639-9103-4f19-a84e-c92d6610ac48 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.729103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09959639-9103-4f19-a84e-c92d6610ac48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.760196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-09959639-9103-4f19-a84e-c92d6610ac48 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:52.762214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-09959639-9103-4f19-a84e-c92d6610ac48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:52.853861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 65/139] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:52.888272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d69e49-d03b-4ba3-a46c-a3d5eb1a1367 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:52.916120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231d13-11de-490a-b74e-79784ca0ab90 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.916462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231d13-11de-490a-b74e-79784ca0ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.916681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231d13-11de-490a-b74e-79784ca0ab90 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.918760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 66/140] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:52.923875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:52.924166 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:52.924545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:52.943553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:52.945262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:52.972571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:53.024469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 67/141] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:53.055084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d69e49-d03b-4ba3-a46c-a3d5eb1a1367 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:53.055605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:53.085515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:53.113332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:53.114202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:53.114481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:53.114994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:53.116434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:53.118665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:53.120733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 75/142] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:53.126876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:53.248906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6689f-d5e3-4639-9460-db51ba74ff35 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:53.262130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb58a2-a77d-42ee-b112-e3234c803155 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:53.306274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:53.307696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:53.308684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:53.309676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:53.311031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:53.313027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:53.315564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:53.316620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:53.317100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:53.317581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:53.339753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:53.348819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:53.349758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:53.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:53.363237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 76/143] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:02:53 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:02:53.364803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 68/144] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:53.371387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:53.426536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:53.510125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631d4a-8d4c-41ec-9da6-047cea9ecb35 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:53.554788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:53.555977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:53.556494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:53.556977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:53.557957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:53.558466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:53.560235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:53.575567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 77/145] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:53.581732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:53.608942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:53.711807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b019-630f-4dc9-b859-26206f232edd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:53.750846 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1c1a3-ef5b-4a94-b5cd-86d3163d444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:53.751801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c1a3-ef5b-4a94-b5cd-86d3163d444d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:53.752087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c1a3-ef5b-4a94-b5cd-86d3163d444d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:53.752364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1c1a3-ef5b-4a94-b5cd-86d3163d444d None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:53.753642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1c1a3-ef5b-4a94-b5cd-86d3163d444d None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:53.755248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1c1a3-ef5b-4a94-b5cd-86d3163d444d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:53.756928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 69/146] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:53 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:53.763096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:53.904708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7fd94-1e53-49e7-b384-703bb076c8aa None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:53.912499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:53.940827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:53.941487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:53.941766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:53.942096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.027510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:54.029068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:54.087802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d5e8-a2ec-429b-9668-77ea6f38357d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.088338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d5e8-a2ec-429b-9668-77ea6f38357d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.088338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8d5e8-a2ec-429b-9668-77ea6f38357d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.089878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 70/147] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:54.095973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.096266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.096546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.127081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:54.128809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:54.204499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 78/148] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:54.210203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:54.212622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:54.233709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 71/149] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:54.282295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:54.321414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:54.391676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe53a67-04bf-489e-a0e0-e5ed0f83f212 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:54.434195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:54.435593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.436088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.436541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.437955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:54.439713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:54.441652 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 79/150] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:54 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:54.452276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:54.508728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d337b2-9060-4206-ac5d-77d806aca32e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:54.571923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5598f33-d8ff-4228-a0b3-15bcc2dc31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:54.572670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5598f33-d8ff-4228-a0b3-15bcc2dc31bd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.572955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5598f33-d8ff-4228-a0b3-15bcc2dc31bd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.573233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5598f33-d8ff-4228-a0b3-15bcc2dc31bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.582822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:54.598393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5598f33-d8ff-4228-a0b3-15bcc2dc31bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e5598f33-d8ff-4228-a0b3-15bcc2dc31bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:54.607975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:54.610511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:54.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 72/151] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:54.616772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c484b-ed1b-4fdc-9975-e9911a9ab077 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.617286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c484b-ed1b-4fdc-9975-e9911a9ab077 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.617775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c484b-ed1b-4fdc-9975-e9911a9ab077 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.620593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e925a-b3fe-41c8-b17f-4be61eef574d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:54.620775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 73/152] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:54.620775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c484b-ed1b-4fdc-9975-e9911a9ab077 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:54.670554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:54.671383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.671667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.671957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.672827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=2ed8f18749b54862825a1a3ad3d01a9d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:54.673141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:54.674623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14c755-4522-442f-9ed2-86871a5a75bf None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:54.682720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 80/153] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:54 2022] GET /identity/v3/role_assignments?user.id=2ed8f18749b54862825a1a3ad3d01a9d&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=4c771a108e9842478e33bd28c8b41844 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:54.684115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077de29-6a72-498d-8abc-532200f9300a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.684443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077de29-6a72-498d-8abc-532200f9300a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.684718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077de29-6a72-498d-8abc-532200f9300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.702877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6077de29-6a72-498d-8abc-532200f9300a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:54.704205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6077de29-6a72-498d-8abc-532200f9300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:54.779497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:54.782406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 81/154] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:54.809829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077de29-6a72-498d-8abc-532200f9300a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:54.833008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c484b-ed1b-4fdc-9975-e9911a9ab077 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:54.885854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:54.925671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:54.926773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.927318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.927790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.928825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:54.929346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:54.933072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077de29-6a72-498d-8abc-532200f9300a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:54.933446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:54.953505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 74/155] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:54.959580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:54.973287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:54.974162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:54.974444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:54.974768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:54.993367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:55.002154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:55.003440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:55.004449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 82/156] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:55.010374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:55.119515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52bb4a-999b-484c-9d2d-218f701dbaa5 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:55.147750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737ef33-ea0f-4839-84dd-eefca91b9a71 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:55.162873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:55.163803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:55.164153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:55.164433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] PATH_INFO: `/v3/users/3f13ec6103904841954d542b2a63064f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:55.165697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] RBAC: Authorizing `identity:get_user(user_id=3f13ec6103904841954d542b2a63064f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:55.167218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:55.169595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 75/157] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:54 2022] GET /identity/v3/users/3f13ec6103904841954d542b2a63064f => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:55.175252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:55.179868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:55.189231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:55.202992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:55.203703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:55.203985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:55.204257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:55.205016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:55.205325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:55.206742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:55.220774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 83/158] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:55.228174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:55.334227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d8b68-f47c-4520-9180-399c7d596bac None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:55.373600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe16076-17c3-48e7-9cf4-c5bd6e451c4c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:55.383111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:55.384365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:55.385295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:55.385772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:55.387988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:55.390487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:55.392776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 76/159] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:55 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:55.398922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:55.421385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:55.422631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:55.423246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:55.423742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] PATH_INFO: `/v3/users/32f50b0a3d2643cab337d0af8f4d09eb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:55.425155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] RBAC: Authorizing `identity:get_user(user_id=32f50b0a3d2643cab337d0af8f4d09eb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:55.427096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:55.429097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 84/160] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:55 2022] GET /identity/v3/users/32f50b0a3d2643cab337d0af8f4d09eb => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:55.437484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:55.486042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:55.514428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e26eb3-b885-409a-bae6-447c63f4a866 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:55.519546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:55.551430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:55.552740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:55.553245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:55.553708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690/users/3f13ec6103904841954d542b2a63064f/roles/d7e8eb03691f4016af76d131e4ce3212` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:55.555946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] RBAC: Authorizing `identity:create_grant(project_id=961fffd1adbf452ab949876aa5822690, user_id=3f13ec6103904841954d542b2a63064f, role_id=d7e8eb03691f4016af76d131e4ce3212)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:55.557619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:55.589601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 77/161] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:02:55 2022] PUT /identity/v3/projects/961fffd1adbf452ab949876aa5822690/users/3f13ec6103904841954d542b2a63064f/roles/d7e8eb03691f4016af76d131e4ce3212 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:02:55.601677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614ec7-38dc-4e0c-af9a-5ec5de26ffad None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:55.652024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:55.653150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:55.653624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:55.654083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:55.740590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:55.742478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:55.810149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:55.869565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 85/162] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:02:55.875416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:56.015574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959cca0-57e8-4843-8d99-107fe674b629 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:56.051503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e102e0-fabf-493d-93e2-73799a7d2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:56.052385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e102e0-fabf-493d-93e2-73799a7d2f66 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.052668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e102e0-fabf-493d-93e2-73799a7d2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.052943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e102e0-fabf-493d-93e2-73799a7d2f66 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.054136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e102e0-fabf-493d-93e2-73799a7d2f66 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:56.055639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e102e0-fabf-493d-93e2-73799a7d2f66 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:56.057618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 78/163] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:55 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:56.067314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:56.150085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50702a6-f835-48cc-b474-9a7872bbbcbe None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.150599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50702a6-f835-48cc-b474-9a7872bbbcbe None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.150599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50702a6-f835-48cc-b474-9a7872bbbcbe None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.152214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 79/164] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:02:56.157447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e7a3-44ef-46f7-847d-17fccab838fe None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.157998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e7a3-44ef-46f7-847d-17fccab838fe None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.158487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428e7a3-44ef-46f7-847d-17fccab838fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.172354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:56.189661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5ad69-cbf9-442a-afb8-920072362cc4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:56.196955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6428e7a3-44ef-46f7-847d-17fccab838fe None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:56.198423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6428e7a3-44ef-46f7-847d-17fccab838fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:56.248165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:56.248838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.249118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.249392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.250230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=32f50b0a3d2643cab337d0af8f4d09eb) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:56.250539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:56.254270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d56cf-a715-467d-9c1e-3e453f59af4b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:56.271492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 86/165] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:56 2022] GET /identity/v3/role_assignments?user.id=32f50b0a3d2643cab337d0af8f4d09eb&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:56.311871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 80/166] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:56.313424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9b96-9a29-4eab-89a4-8b47273fccf8 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.313710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9b96-9a29-4eab-89a4-8b47273fccf8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.313982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9b96-9a29-4eab-89a4-8b47273fccf8 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.315441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 87/167] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:02:56.324046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.324575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.325067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.347648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:56.349217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:56.356365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9b96-9a29-4eab-89a4-8b47273fccf8 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:56.391342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:56.510819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 81/168] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:56.535139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:56.571310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9b96-9a29-4eab-89a4-8b47273fccf8 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:56.640679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:56.641831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.642326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.642841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.650555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:56.678803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:56.691578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:56.693009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:56.693772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 88/169] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:56.700946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:56.722711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b24cd-bd89-450f-9d64-19d9b301e39a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:56.812560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:56.813309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.813595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.813869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.844300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:56.850694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:56.862684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:56.863619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:02:56.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:56.868167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 82/170] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:56.876824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672ef2-8012-4046-a5e5-56dfd88d9c5a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:56.877223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:56.924310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:56.925003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:56.925285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:56.925560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:56.926333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:56.926642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:56.928137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:56.937046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 89/171] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:02:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:56.943812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:57.090409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42d0f6-7252-45a4-b3ec-e48937a1f84c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:57.141258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3291ef9-badb-43e7-9b3b-b4d8216ca91e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:57.183891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:57.184827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:57.185108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:57.185385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:57.186615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:57.188109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:57.189968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 90/172] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:56 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:57.194074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:57.198027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:57.215331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:57.235902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:57.236601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:57.236885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:57.237159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:57.237925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:57.238233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:57.239688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:57.258382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 83/173] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:57.264065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:57.459036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9d5cb-be10-4107-95b1-2c18cb1e89ae None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:57.503206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0aa06b-93c9-4053-8819-48c5bc032f65 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:57.547646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:57.547646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:57.547646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:57.547646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:57.557184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:57.558439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:57.558928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:57.559469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] PATH_INFO: `/v3/users/2ed8f18749b54862825a1a3ad3d01a9d` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:57.563946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] RBAC: Authorizing `identity:get_user(user_id=2ed8f18749b54862825a1a3ad3d01a9d)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:57.565722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:57.568066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 84/174] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:57 2022] GET /identity/v3/users/2ed8f18749b54862825a1a3ad3d01a9d => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:57.573202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:57.632924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:57.632924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:57.665394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:57.703641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:57.807785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 91/175] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:02:57.814663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:57.845210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a4d99-37a8-4263-a02a-84713bd5f4ee None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:57.911468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:57.913217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:57.916232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:57.916684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:57.997451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:58.001850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:58.011466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cc3c8-cbb2-413b-a54b-4c06b47709c8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:58.029059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:58.081323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:58.083932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.084575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.085702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.087427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:58.096127 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:58.098566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:58.099830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 92/176] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:57 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:58.113446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:58.221743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 85/177] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:02:58.227382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:58.260941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ad233-98a5-41ee-899e-5529f8bf3918 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:58.300460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:58.301422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.302051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.303174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.304342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] RBAC: Adding query filter params (role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=2ed8f18749b54862825a1a3ad3d01a9d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:58.310156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:58.311930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:58.320794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 93/178] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:58 2022] GET /identity/v3/role_assignments?user.id=2ed8f18749b54862825a1a3ad3d01a9d&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:58.400421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fff09d-dd91-4808-92a0-349a116a043f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:58.449649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a67a05-5e8c-4dee-9acc-62f94bd4f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:58.450857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67a05-5e8c-4dee-9acc-62f94bd4f96c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.451315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67a05-5e8c-4dee-9acc-62f94bd4f96c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.451726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a67a05-5e8c-4dee-9acc-62f94bd4f96c None admin] PATH_INFO: `/v3/projects/b3a5e977a6a546bb886f5031008483e4` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.456115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67a05-5e8c-4dee-9acc-62f94bd4f96c None admin] RBAC: Authorizing `identity:get_project(project_id=b3a5e977a6a546bb886f5031008483e4)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:58.457968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a67a05-5e8c-4dee-9acc-62f94bd4f96c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:58.460506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 86/179] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:02:58 2022] GET /identity/v3/projects/b3a5e977a6a546bb886f5031008483e4 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:02:58.466208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:58.530957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:58.605536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ff5e-f93b-4549-8743-e6ef8b65baf5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:58.634726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866f97-caac-4def-8db8-e259e543b37f None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.635167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866f97-caac-4def-8db8-e259e543b37f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.635564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866f97-caac-4def-8db8-e259e543b37f None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.637251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 87/180] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:58.642847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbbf1a-238c-4ffb-a66c-3128295c3e25 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.643271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbbf1a-238c-4ffb-a66c-3128295c3e25 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.643656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbbf1a-238c-4ffb-a66c-3128295c3e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.650287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:58.651146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.651586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.651997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.653045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=b3a5e977a6a546bb886f5031008483e4, user.id=2ed8f18749b54862825a1a3ad3d01a9d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:58.653502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:58.655178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abaa2e8-dc12-4876-91a9-f6a2fb111a0b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:58.666168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d7cbbf1a-238c-4ffb-a66c-3128295c3e25 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:58.666168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d7cbbf1a-238c-4ffb-a66c-3128295c3e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:58.666626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 94/181] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:02:58 2022] GET /identity/v3/role_assignments?user.id=2ed8f18749b54862825a1a3ad3d01a9d&scope.project.id=b3a5e977a6a546bb886f5031008483e4&role.id=4c771a108e9842478e33bd28c8b41844 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:58.682345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:58.710520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdffe2-f1e0-4718-9500-9af3132fdce8 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.711218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdffe2-f1e0-4718-9500-9af3132fdce8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.712710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdffe2-f1e0-4718-9500-9af3132fdce8 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.714435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 95/182] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:58.729106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.729670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.730135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.779281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:58.780516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:58.814636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 88/183] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:58.817669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25380-88ac-4e04-b055-bccfc0e164aa None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.817955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25380-88ac-4e04-b055-bccfc0e164aa None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.818235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca25380-88ac-4e04-b055-bccfc0e164aa None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.819939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 89/184] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:58.846287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:58.846618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:58.846850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:58.880561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:58.881690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:58.911611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 96/185] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:58.915432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:58.957900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.004827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 90/186] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:02:59.005926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.072996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e58ba3-9f68-46ab-9fda-8fb3701e06cc None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.100643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.118286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8f85a-bd91-4ee7-a13f-8e83cf5b71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.119111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8f85a-bd91-4ee7-a13f-8e83cf5b71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.119427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8f85a-bd91-4ee7-a13f-8e83cf5b71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.119715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8f85a-bd91-4ee7-a13f-8e83cf5b71b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.122484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede4a96-7833-4fee-9093-55a3810bd24b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.130386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8f85a-bd91-4ee7-a13f-8e83cf5b71b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a5a8f85a-bd91-4ee7-a13f-8e83cf5b71b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:59.140630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:59.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:59.142279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 97/187] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:02:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:59.143449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7db77-da79-4132-8f0f-b9048044ed25 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.143449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7db77-da79-4132-8f0f-b9048044ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.143666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7db77-da79-4132-8f0f-b9048044ed25 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.145046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 98/188] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:02:59.145684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7db77-da79-4132-8f0f-b9048044ed25 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.158940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.159831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.160106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.160373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.161532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.162996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.164591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 91/189] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:59.168474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.251604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.263403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7db77-da79-4132-8f0f-b9048044ed25 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.271289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456cd2b-94b0-4a1a-9584-4e0c91ba52b3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.302494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.303330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.303607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.303882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.308047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.308721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.309108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.309378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.310122 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:59.310429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.311842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7905b58e-5636-46ad-9993-f1c5bc4bfae3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.317314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:59.320219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 92/190] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:59.321296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.321573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.321855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:59.325539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:59.326511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:02:59.327300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 99/191] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:59.327941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.340894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:59.342107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:59.345169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.416551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 93/192] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:02:59.417355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.443804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7a845-1ab9-4a98-b4da-1301640fed1d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.481451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.482380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.482661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.482958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.483706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.485264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.514806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 100/193] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:02:59 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:02:59.527462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.529542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.543584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12585f31-c60f-4e34-810b-661a43d97a13 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.590428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.591872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.592142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.592708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] PATH_INFO: `/v3/users/9a8b6169938b417fb541703699975cad` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.608744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.616509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] RBAC: Authorizing `identity:get_user(user_id=9a8b6169938b417fb541703699975cad)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.618542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.625130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 94/194] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/users/9a8b6169938b417fb541703699975cad => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:59.625130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.641668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea40b-9247-4422-b967-6bf23c46952f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.682538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673b796-b065-4039-9158-802860174167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.683143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673b796-b065-4039-9158-802860174167 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.683451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673b796-b065-4039-9158-802860174167 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.683732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673b796-b065-4039-9158-802860174167 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.684490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673b796-b065-4039-9158-802860174167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:02:59.684805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673b796-b065-4039-9158-802860174167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.686228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673b796-b065-4039-9158-802860174167 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.696022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 101/195] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:59.696819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673b796-b065-4039-9158-802860174167 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.740329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18839-69e1-4af6-9600-3fd548faae22 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.781890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.785850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.786004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.786004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.786004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.800323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:02:59.808231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:02:59.809359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:02:59.810129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 95/196] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:02:59.811376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:02:59.829063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673b796-b065-4039-9158-802860174167 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.873823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.874486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.874771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.875050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.887679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:59.936525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155e881-902e-4aa9-b0ca-9c4564a35cd7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:02:59.972825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.974368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.981984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:02:59.983760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:59.984249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:59.984722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] PATH_INFO: `/v3/users/9a8b6169938b417fb541703699975cad` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:59.986587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9a8b6169938b417fb541703699975cad)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:02:59.988902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:02:59.991447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 96/197] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/users/9a8b6169938b417fb541703699975cad => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:02:59.992743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.048366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.092381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 102/198] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:00.093880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.112860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55331cc5-4aff-4689-b6ce-67951008c8e4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.142875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.159316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.160105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.160393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.160668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.161425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:00.162251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.164037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:00.176055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 97/199] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:02:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:00.177396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.218526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748efc3-f2ce-40ea-93ff-15aea269537c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.257712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.258526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.258812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.259234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.302106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e741-36be-4d12-8b99-3f8da937adb7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.310695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.338516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.339530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.339864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.340198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.341492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.343068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:00.344070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.344979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 98/200] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:00.345646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:00.350631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.413278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.470534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76a4c-efb0-4c77-85c8-0287350210fd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.479223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 103/201] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:00.480230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.516478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.518254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.518677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.519115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] PATH_INFO: `/v3/users/3f13ec6103904841954d542b2a63064f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.521694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] RBAC: Authorizing `identity:get_user(user_id=3f13ec6103904841954d542b2a63064f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.523382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:00.525170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 99/202] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/users/3f13ec6103904841954d542b2a63064f => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:00.530405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.563747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.595575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b5bbb-c377-4b38-a0fe-7a948673661a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.629907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.630571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.630849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.631117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.631996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] RBAC: Adding query filter params (role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=8f124894c75f461190896e7567aef362, user.id=9a8b6169938b417fb541703699975cad) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:00.632309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.633778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:00.639440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 104/203] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/role_assignments?user.id=9a8b6169938b417fb541703699975cad&scope.project.id=8f124894c75f461190896e7567aef362&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:00.643445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.690383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483e5d5-981a-464a-a546-5e6731d29910 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.735325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.754978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.756915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.757919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.758403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.760233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.762434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:00.765266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 100/204] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:00.774101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:00.866011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ad21c-e99d-4394-9fd5-41ead85f59ac None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.947930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.948618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.948902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.949182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.953873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df38581-1236-40ee-9770-4e9408c3cfa9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:00.958663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:00.990489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:00.991231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:00.991578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:00.991918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:00.992867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=8f124894c75f461190896e7567aef362, user.id=9a8b6169938b417fb541703699975cad) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:00.993250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:00.994787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:01.001149 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 101/205] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/role_assignments?user.id=9a8b6169938b417fb541703699975cad&scope.project.id=8f124894c75f461190896e7567aef362&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:01.076793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:01.076793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:01.230419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 105/206] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:01.236678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:01.313764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:01.363772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fddc1c-b976-43c3-a0bd-2d5663a3c1d6 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:01.399286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729360b-c098-45d3-9408-a66e4c10876c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:01.400182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729360b-c098-45d3-9408-a66e4c10876c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:01.400463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729360b-c098-45d3-9408-a66e4c10876c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:01.400737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729360b-c098-45d3-9408-a66e4c10876c None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:01.401947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729360b-c098-45d3-9408-a66e4c10876c None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:01.403574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3729360b-c098-45d3-9408-a66e4c10876c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:01.405354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 102/207] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:01 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:01.411517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:01.453219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:01.533023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d62fd4-f8a7-4191-a4fd-79e59dee0aca None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:01.577238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:01.578248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:01.578726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:01.579249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:01.580300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] RBAC: Adding query filter params (role.id=d7e8eb03691f4016af76d131e4ce3212, scope.project.id=961fffd1adbf452ab949876aa5822690, user.id=3f13ec6103904841954d542b2a63064f) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:01.580805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:01.582471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526b1e5-f7cd-4dc1-bf5b-9dbef4cfa6a0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:01.589102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 106/208] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:01 2022] GET /identity/v3/role_assignments?user.id=3f13ec6103904841954d542b2a63064f&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=d7e8eb03691f4016af76d131e4ce3212 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:02.105570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b4d6-47cf-4096-8d21-ee676ff3adce None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.105915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b4d6-47cf-4096-8d21-ee676ff3adce None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.106158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922b4d6-47cf-4096-8d21-ee676ff3adce None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.107578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 103/209] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:02.113074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.113584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.114054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.125091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44923b7-b91d-4cc0-b6a6-fb8b36304426 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.125692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44923b7-b91d-4cc0-b6a6-fb8b36304426 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.126160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44923b7-b91d-4cc0-b6a6-fb8b36304426 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.127777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 104/210] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:02.133057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.133583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.134052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.136269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:02.138632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:02.153746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:02.154943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:02.214005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 107/211] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:02.238810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:02.242084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 105/212] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:02.265812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:02.270333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:02.323614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:02.345532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d778-eaa8-49fd-b8d1-8b9fea715039 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:02.373232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d52bc3-a7dd-4e31-a37b-b324b858b9fd None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:02.382682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:02.383538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.383913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.384192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.385459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:02.386942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:02.393416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 108/213] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:02.394305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:02.411079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:02.411940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.412318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.412597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.424583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:02.432884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:02.433769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:02.434598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:02.439091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 106/214] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:02.440526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:02.491471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:02.494970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32326b-9dc7-4104-b9f6-e25aff56fece None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:02.529168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:02.529846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.530125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.530394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.531106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:02.532587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:02.555699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a629ec-2ac8-4cdd-b9eb-eabd66b25c06 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:02.563735 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 109/215] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:02 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:03:02.578040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:02.603328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:02.604140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.604428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.604810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.605777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:02.606153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:02.607754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:02.618248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 107/216] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:02.624048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:02.747821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32202202-dc7e-41db-995d-c2eae8babb53 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:02.792572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:02.793889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.794167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.794437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] PATH_INFO: `/v3/users/83a3ddd20e0b410eb7042a38e79c9bf3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:02.809784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] RBAC: Authorizing `identity:get_user(user_id=83a3ddd20e0b410eb7042a38e79c9bf3)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:02.811334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:02.813437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 110/217] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:02 2022] GET /identity/v3/users/83a3ddd20e0b410eb7042a38e79c9bf3 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:02.818949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:02.932900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08d51-3c81-434d-9d2d-7dbe8d1d6513 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:02.972340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92e06b-0d39-46ef-9884-24fd6a7e63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:02.973017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e06b-0d39-46ef-9884-24fd6a7e63ea None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:02.973300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e06b-0d39-46ef-9884-24fd6a7e63ea None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:02.973575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92e06b-0d39-46ef-9884-24fd6a7e63ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.024447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:03.050789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e06b-0d39-46ef-9884-24fd6a7e63ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:03.052325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92e06b-0d39-46ef-9884-24fd6a7e63ea None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:03.172258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 108/218] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:03.177644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:03.202594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:03.330206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21811082-2d0c-4cd6-8b12-1a3cde1aeaaf None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:03.332598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5912-48b8-4857-a2ac-3f0e5d4f9d17 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.333358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5912-48b8-4857-a2ac-3f0e5d4f9d17 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.333703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa5912-48b8-4857-a2ac-3f0e5d4f9d17 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.339494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 109/219] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:03.340920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.341274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.341623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.364907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:03.369546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:03.399069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:03.399981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.400261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.400540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.404554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:03.406032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:03.415071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 111/220] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:03 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:03.421197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:03.510579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 110/221] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:03.533595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:03.546295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:03.553074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:03.593595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523051e-1e7f-4c6d-b698-67c83a1ff9cd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:03.640517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:03.641188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.641842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.642128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.643255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=8f124894c75f461190896e7567aef362, user.id=83a3ddd20e0b410eb7042a38e79c9bf3) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:03.643570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:03.645288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df276cb-3833-4a84-99f5-75c37816e14c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:03.653547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 112/222] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:03 2022] GET /identity/v3/role_assignments?user.id=83a3ddd20e0b410eb7042a38e79c9bf3&scope.project.id=8f124894c75f461190896e7567aef362&role.id=4c771a108e9842478e33bd28c8b41844 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:03.654884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55f31-d288-458b-84fa-e82a86e4de88 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.655178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55f31-d288-458b-84fa-e82a86e4de88 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.655459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b55f31-d288-458b-84fa-e82a86e4de88 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.656868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 113/223] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:03.666072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.666300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.666701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.687283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:03.688666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:03.689574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a32f13-9f85-499b-9c4b-15487a193d3c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:03.772290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 114/224] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:03.788585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:03.789435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.789716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.789987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.795062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:03.820147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:03.828425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:03.830520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:03.832526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:03.839726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 111/225] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:03.845764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:03.879729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:03.909245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290bb9e-e2f0-4bc6-8ad0-ff1a860c2a2c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:03.949946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:03.951064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:03.951385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:03.951929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:03.966200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:03.976083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:03.976957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:03.977734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:03.978344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 115/226] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:03.985515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:03.993838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:04.041003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5959-e630-4371-82bb-f749d31ae195 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.106934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52734b-2803-4748-b0ea-642d307caef6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.129291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.129974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.130254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.130526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.131311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:04.131620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.133026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.154638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.154970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 112/227] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:04.155442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.155721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.155999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.156816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:04.157163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.158638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.160399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:04.169355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:04.180744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 116/228] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:04.186050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:04.308368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca47ce-3baf-461b-9a4f-073cbd1086c9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.342647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.343576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.343856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.344130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] PATH_INFO: `/v3/users/9a8b6169938b417fb541703699975cad` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.348468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] RBAC: Authorizing `identity:get_user(user_id=9a8b6169938b417fb541703699975cad)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.349954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.351831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 117/229] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:04 2022] GET /identity/v3/users/9a8b6169938b417fb541703699975cad => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:04.358784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:04.387084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a24281-8e5c-4d5b-aae2-6f263eb58701 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.438021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:04.453703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.454600 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.454900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.455173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] PATH_INFO: `/v3/users/9a8b6169938b417fb541703699975cad` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.456550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] RBAC: Authorizing `identity:get_user(user_id=9a8b6169938b417fb541703699975cad)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.458030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.465352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 113/230] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:04 2022] GET /identity/v3/users/9a8b6169938b417fb541703699975cad => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:04.471364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:04.495543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:04.552092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb848-3319-4a8a-85e6-589c9352900c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.629609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.630405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.630684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.630959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.634175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c799fb4-d4dc-4ae0-81c7-89930e1cbcd8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.636362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.637971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.643495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 118/231] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:04 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:04.645463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:04.690245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.691129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.693515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.693791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.695935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.697406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.699314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 114/232] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:04 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:04.706072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:04.831542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:04.841126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499d2d-0e8c-4c7a-b6eb-5230bd9cc5dd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.884336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:04.890448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25294fe-7c69-4fca-b277-269b1114546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.891667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25294fe-7c69-4fca-b277-269b1114546a None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.892172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25294fe-7c69-4fca-b277-269b1114546a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.892639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25294fe-7c69-4fca-b277-269b1114546a None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362/users/9a8b6169938b417fb541703699975cad/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.895169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25294fe-7c69-4fca-b277-269b1114546a None admin] RBAC: Authorizing `identity:create_grant(project_id=8f124894c75f461190896e7567aef362, user_id=9a8b6169938b417fb541703699975cad, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.897117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25294fe-7c69-4fca-b277-269b1114546a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:04.905993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3befa85-e3ca-431d-9680-be37381b2e7b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:04.915198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 119/233] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:04 2022] PUT /identity/v3/projects/8f124894c75f461190896e7567aef362/users/9a8b6169938b417fb541703699975cad/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:04.983055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074894d-816c-4384-8427-61d428fcf984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:04.984038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074894d-816c-4384-8427-61d428fcf984 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:04.984465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074894d-816c-4384-8427-61d428fcf984 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:04.984934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074894d-816c-4384-8427-61d428fcf984 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362/users/9a8b6169938b417fb541703699975cad/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:04.994515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074894d-816c-4384-8427-61d428fcf984 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f124894c75f461190896e7567aef362, user_id=9a8b6169938b417fb541703699975cad, role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:04.997181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074894d-816c-4384-8427-61d428fcf984 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:05.024451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 115/234] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:04 2022] PUT /identity/v3/projects/8f124894c75f461190896e7567aef362/users/9a8b6169938b417fb541703699975cad/roles/6e9210d695b14e9bb259dbc706a59244 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:05.434657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05debd6e-b731-40f8-aa4b-f6c94f9d3fb8 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:05.435229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05debd6e-b731-40f8-aa4b-f6c94f9d3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:05.435229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05debd6e-b731-40f8-aa4b-f6c94f9d3fb8 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:05.436843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 120/235] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:05.443058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:05.443552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:05.443624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:05.468330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:05.469572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:05.469811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325b0a-a3ad-4fe0-a96a-1539652d3f0d None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:05.470093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325b0a-a3ad-4fe0-a96a-1539652d3f0d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:05.470362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc325b0a-a3ad-4fe0-a96a-1539652d3f0d None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:05.471918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 121/236] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:05.477060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:05.477345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:05.477619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:05.494828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:05.496260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:05.581849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 116/237] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:05.589873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 122/238] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:05.614010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:05.614195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:05.679410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:05.740647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36151d39-6275-4838-ac0b-8c66588406e6 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:05.765935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f4433-ebe7-47c2-9d5c-5e07e493492d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:05.767587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:05.789584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:05.790770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:05.792628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:05.793527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:05.818798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:05.834225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:05.835135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:05.835958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:05.841129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 123/239] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:05.841955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:05.842982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:05.843550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:05.844540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:05.844988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:05.846658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:05.848749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:05.852561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 117/240] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:05.863042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.038817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984fe2-dcad-49a0-9307-a4752df35fe6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.096682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16659cb6-0112-45e0-83b9-9a27248564f7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.119781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.120520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.120802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.121081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.122064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:06.122376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:06.123844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:06.135071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 124/241] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:06.141780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.158103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:06.196075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:06.207883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.208721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.208940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.209211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.209932 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:06.211433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:06.254732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dda04-845d-4cd5-9abf-66c17032e542 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.291068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4206372-18de-4c21-9d30-66625e3e4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.292038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206372-18de-4c21-9d30-66625e3e4361 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.292249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206372-18de-4c21-9d30-66625e3e4361 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.292525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4206372-18de-4c21-9d30-66625e3e4361 None admin] PATH_INFO: `/v3/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.298057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 118/242] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:05 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:06.307861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4206372-18de-4c21-9d30-66625e3e4361 None admin] RBAC: Authorizing `identity:get_user(user_id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:06.309614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4206372-18de-4c21-9d30-66625e3e4361 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:06.311780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 125/243] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:06.317687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.361381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066c36-c8f0-4d37-9e75-2a65d9734c16 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.361711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066c36-c8f0-4d37-9e75-2a65d9734c16 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.361936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e066c36-c8f0-4d37-9e75-2a65d9734c16 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.363392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 126/244] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:06.370074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.370349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.370629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.390683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:06.392366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:06.512623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946181d3-f0bc-4d93-a9d5-6d5873acce7f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.524887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 127/245] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:03:06.562322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.581119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.582243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.582749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.583330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.601618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:06.636262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:06.662483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:06.664370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:06.677612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c4665-0a12-4d03-bc0e-bad85cbd5073 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.714069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.715889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.716433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.728211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:06.736945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:06.737819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:06.738591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:06.740976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 128/246] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:06.747258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.779180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 119/247] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:06.781289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.870439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:06.878943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:06.881062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f1ddc-8d67-454e-8a91-07441e8c3d7c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.907123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97059c28-55b8-47be-ba0b-128d184ae451 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:06.920448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.921480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.921958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.922425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.923537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:06.924091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:06.925707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:06.936049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 129/248] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:06.941170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:06.944829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:06.946152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:06.946152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:06.946496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:06.947808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:06.949462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:06.951805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 120/249] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:06.957873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:07.054611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd1f10-350d-43c9-a7d6-940e6ecdb143 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:07.080216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f608abf-9735-420a-8b83-f3e8f2aa0b59 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:07.092479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:07.093602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.094028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.094443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] PATH_INFO: `/v3/users/83a3ddd20e0b410eb7042a38e79c9bf3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.096144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] RBAC: Authorizing `identity:get_user(user_id=83a3ddd20e0b410eb7042a38e79c9bf3)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:07.097800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:07.099946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 130/250] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/users/83a3ddd20e0b410eb7042a38e79c9bf3 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:07.108422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:07.119393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:07.120203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.120632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.120945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.122025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] RBAC: Adding query filter params (role.id=d7e8eb03691f4016af76d131e4ce3212, scope.project.id=8f124894c75f461190896e7567aef362, user.id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:07.122321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:07.123911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:07.130477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 121/251] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:06 2022] GET /identity/v3/role_assignments?user.id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1&scope.project.id=8f124894c75f461190896e7567aef362&role.id=d7e8eb03691f4016af76d131e4ce3212 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:07.145300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:07.237886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede81a9-9894-4f7b-8766-ecd9a3f3bee5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:07.276764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abaf117-84c2-471d-9751-f250d7aca41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:07.278128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaf117-84c2-471d-9751-f250d7aca41d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.278555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaf117-84c2-471d-9751-f250d7aca41d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.278982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abaf117-84c2-471d-9751-f250d7aca41d None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.280466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaf117-84c2-471d-9751-f250d7aca41d None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:07.282121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abaf117-84c2-471d-9751-f250d7aca41d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:07.284460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 131/252] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:07 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:07.290098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:07.313215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:07.426770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11993e5d-4fc2-4e25-b74a-63b8a66f63b5 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:07.461432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36e3b7-da41-4bda-99a6-c8e71e6e2ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:07.462336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e3b7-da41-4bda-99a6-c8e71e6e2ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.462615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e3b7-da41-4bda-99a6-c8e71e6e2ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.462973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36e3b7-da41-4bda-99a6-c8e71e6e2ab6 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362/users/83a3ddd20e0b410eb7042a38e79c9bf3/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.465070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36e3b7-da41-4bda-99a6-c8e71e6e2ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f124894c75f461190896e7567aef362, user_id=83a3ddd20e0b410eb7042a38e79c9bf3, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:07.466582 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36e3b7-da41-4bda-99a6-c8e71e6e2ab6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:07.488478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 122/253] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:07 2022] PUT /identity/v3/projects/8f124894c75f461190896e7567aef362/users/83a3ddd20e0b410eb7042a38e79c9bf3/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:07.538848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843be74-9b0e-4757-bc4c-e08cf6b3bbe5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.539949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843be74-9b0e-4757-bc4c-e08cf6b3bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.540422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843be74-9b0e-4757-bc4c-e08cf6b3bbe5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.542159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 132/254] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:07.553292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.553822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.553822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.577404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:07.578640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:07.648830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:07.654141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 123/255] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:07.689206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843be74-9b0e-4757-bc4c-e08cf6b3bbe5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:07.826569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:07.840872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843be74-9b0e-4757-bc4c-e08cf6b3bbe5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:07.881266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08587b8a-9695-4e58-a5b3-c8f00ef3abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:07.882139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08587b8a-9695-4e58-a5b3-c8f00ef3abf2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.882428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08587b8a-9695-4e58-a5b3-c8f00ef3abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.882700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08587b8a-9695-4e58-a5b3-c8f00ef3abf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.894255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08587b8a-9695-4e58-a5b3-c8f00ef3abf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-08587b8a-9695-4e58-a5b3-c8f00ef3abf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:07.902092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:07.903091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:07.904500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 133/256] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:07.909400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:07.972726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb01a3-5233-4cd7-b54b-4290ca0ca195 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.973015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb01a3-5233-4cd7-b54b-4290ca0ca195 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.973189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb01a3-5233-4cd7-b54b-4290ca0ca195 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:07.975447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 134/257] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:07.982072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:07.982359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:07.982634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:08.013339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:08.016517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:08.063404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9d700-cbe8-4c29-a451-eaeee54c99cc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:08.135266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:08.135951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:08.136235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:08.136511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:08.137323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:08.137631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:08.139041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:08.154809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 135/258] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:03:08.163369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 124/259] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:08.168977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:08.193434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:08.320425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:08.337730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:08.345450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d47a0e-fa1b-4867-a8c6-fe3a010777b0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:08.387989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:08.388889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:08.389166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:08.389440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] PATH_INFO: `/v3/users/9a8b6169938b417fb541703699975cad` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:08.394167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] RBAC: Authorizing `identity:get_user(user_id=9a8b6169938b417fb541703699975cad)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:08.395684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:08.402188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 136/260] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:08 2022] GET /identity/v3/users/9a8b6169938b417fb541703699975cad => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:08.403134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:08.433087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63376c91-beda-45a9-8711-cd7cb1f4f3e8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:08.528226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f654a-2395-4acb-bb15-e105a857fac9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:08.547959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:08.548812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:08.549102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:08.549377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:08.571972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:08.594386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:08.595372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:08.596159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:08.597354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 125/261] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:08.604336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:08.624655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:08.625316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:08.625595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:08.625868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:08.670033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:08.780296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:08.781998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:08.886705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f500cba-1ab3-4d36-b50f-245f1ffa3d40 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:08.931533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:08.955872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:08.956561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:08.956848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:08.957382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:08.957882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:08.958188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:08.959630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:08.972967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 126/262] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:08.979141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:09.023032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 137/263] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:09.028421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:09.132808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc9bc-06ca-49bc-a718-c9b5ce1d3559 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:09.164781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:09.191867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:09.192774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:09.193059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:09.193332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] PATH_INFO: `/v3/users/9a8b6169938b417fb541703699975cad` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:09.194572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=9a8b6169938b417fb541703699975cad)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:09.196064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:09.198086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 127/264] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:08 2022] GET /identity/v3/users/9a8b6169938b417fb541703699975cad => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:09.203830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:09.223434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1c6e6-cad0-4772-a612-d4e5e21d399c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:09.278277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:09.279170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:09.279446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:09.279714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:09.282457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:09.283928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:09.285797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 138/265] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:09 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:09.292651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:09.322110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:09.420659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6b6f9-3582-4ce7-ace5-060295f56ae7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:09.471287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1582705-88a1-44d6-adff-ec86cab759f0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:09.486439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:09.487455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:09.487976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:09.488522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:09.489610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:09.529472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:09.530147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:09.530425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:09.530700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:09.531564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=8f124894c75f461190896e7567aef362, user.id=9a8b6169938b417fb541703699975cad) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:09.531873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:09.533336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:09.553848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 139/266] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:09 2022] GET /identity/v3/role_assignments?user.id=9a8b6169938b417fb541703699975cad&scope.project.id=8f124894c75f461190896e7567aef362&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:09.571037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:09.572914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:09.640028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:09.711297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 128/267] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:03:09.717344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:09.829567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb2015-07fe-47b0-a70e-ae425c5ef943 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:09.866685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786daac5-c068-4704-9138-4b047177c1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:09.868004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786daac5-c068-4704-9138-4b047177c1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:09.868480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786daac5-c068-4704-9138-4b047177c1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:09.868944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786daac5-c068-4704-9138-4b047177c1d9 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:09.870356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786daac5-c068-4704-9138-4b047177c1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:09.872169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786daac5-c068-4704-9138-4b047177c1d9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:09.874374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 140/268] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:09 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:09.880458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:09.995838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c892f0c-f35a-489b-96dd-13c96b638aa7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:10.041772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:10.043275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.043748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.044253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.045271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] RBAC: Adding query filter params (role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=8f124894c75f461190896e7567aef362, user.id=9a8b6169938b417fb541703699975cad) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:10.045795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:10.047571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab6d54-a401-4f9c-be2d-0a1e8c079223 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:10.059968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 129/269] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:09 2022] GET /identity/v3/role_assignments?user.id=9a8b6169938b417fb541703699975cad&scope.project.id=8f124894c75f461190896e7567aef362&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:10.282397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193613df-872c-49fb-b0cd-e30670b26b20 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.283111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193613df-872c-49fb-b0cd-e30670b26b20 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.283601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193613df-872c-49fb-b0cd-e30670b26b20 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.285491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 141/270] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:10.290860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.291168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.291454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.315727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:10.316984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:10.333460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:10.393553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb1ae-7859-4fb7-8a7e-9c3b1a18ddab None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.394208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb1ae-7859-4fb7-8a7e-9c3b1a18ddab None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.394705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb1ae-7859-4fb7-8a7e-9c3b1a18ddab None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.396523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 142/271] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:10.402707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.403366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.403836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.406887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 130/272] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:10.425777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:10.427360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:10.432079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:10.476848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:10.511859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 143/273] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:03:10.537780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:10.556981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a151485-c562-4dcd-982f-37e703ff33b1 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:10.592003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fb5ae-a66d-41dc-a63c-d44a8208b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:10.592897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb5ae-a66d-41dc-a63c-d44a8208b864 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.593080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb5ae-a66d-41dc-a63c-d44a8208b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.593351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fb5ae-a66d-41dc-a63c-d44a8208b864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.603872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fb5ae-a66d-41dc-a63c-d44a8208b864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-405fb5ae-a66d-41dc-a63c-d44a8208b864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:10.611561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:10.612465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 131/274] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:10.618743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1020-c22c-437b-8b47-24e725d83210 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.619637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1020-c22c-437b-8b47-24e725d83210 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.619637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1020-c22c-437b-8b47-24e725d83210 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.619637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 132/275] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:10.620876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1020-c22c-437b-8b47-24e725d83210 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:10.631365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:10.657578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d00f-07e5-4a43-b00b-7e11a4167971 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:10.694835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbddba-5078-47ea-bd43-71899e0cb6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:10.695673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbddba-5078-47ea-bd43-71899e0cb6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.695924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbddba-5078-47ea-bd43-71899e0cb6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.696227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbddba-5078-47ea-bd43-71899e0cb6f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.706921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbddba-5078-47ea-bd43-71899e0cb6f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c1bbddba-5078-47ea-bd43-71899e0cb6f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:10.714745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:10.715737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:10.716507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 144/276] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:10.720923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.721481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.721481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1020-c22c-437b-8b47-24e725d83210 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:10.738033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:10.739225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:10.766109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:10.766786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.767070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.767370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.768132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:10.768245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:10.768436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:10.769923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afd7ed-a0f2-49ed-aef1-f57e3f8fa02c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:10.778685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 133/277] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:10.780157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04accb-4681-4d8a-8696-8ac5beb2c71d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.780433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04accb-4681-4d8a-8696-8ac5beb2c71d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.780699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04accb-4681-4d8a-8696-8ac5beb2c71d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.781904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 134/278] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:10.782585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04accb-4681-4d8a-8696-8ac5beb2c71d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:10.810673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 145/279] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:10.811886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:10.850685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:10.886747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04accb-4681-4d8a-8696-8ac5beb2c71d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:10.908916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf89bbb-f045-4087-bd73-761e5b3d43be None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:10.921953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:10.922628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.922904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.923214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.923951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:10.924289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:10.925686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec602c7-da4d-49be-88ab-d906d5b25b09 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:10.934919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 135/280] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:10.936400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285318-9064-4212-93b7-10672b48a643 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.936684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285318-9064-4212-93b7-10672b48a643 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.936956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285318-9064-4212-93b7-10672b48a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.948497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:10.949526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:10.949827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:10.950103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] PATH_INFO: `/v3/users/559768284137429482533b16379c2fb5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:10.954532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-32285318-9064-4212-93b7-10672b48a643 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:10.955770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-32285318-9064-4212-93b7-10672b48a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:10.963542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] RBAC: Authorizing `identity:get_user(user_id=559768284137429482533b16379c2fb5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:10.965030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:10.966709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 146/281] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:10 2022] GET /identity/v3/users/559768284137429482533b16379c2fb5 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:10.967513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:10.994653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.025189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 136/282] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:11.026116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32285318-9064-4212-93b7-10672b48a643 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.070138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2dd8-cc9d-49e6-989a-e7ff1e4abdf3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.086254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.104273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.105068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.105343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.105635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.106772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.108257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.109855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 147/283] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:11.110601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.127772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32285318-9064-4212-93b7-10672b48a643 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.162343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.163227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.163502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.163762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] PATH_INFO: `/v3/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.164925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] RBAC: Authorizing `identity:get_user(user_id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.166373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.172960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 137/284] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:11.172960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.200684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.207332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb12fa4-4842-482f-89d4-68969ca17e35 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.243502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.244150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.244427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.244695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.245512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, user.id=559768284137429482533b16379c2fb5, scope.system=all) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:11.245819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.247351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.252344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 148/285] 10.222.0.45 () {56 vars in 1308 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/role_assignments?user.id=559768284137429482533b16379c2fb5&scope.system=all&role.id=4c771a108e9842478e33bd28c8b41844 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:11.252915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.281902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6174495-25ab-4766-a01a-f31abd468334 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.322659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.334522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.335785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.335785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.335950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.348879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:11.357182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:11.358317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 138/286] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:11.359213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.377145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33fdd-1c9e-42f4-a114-86852810eada None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.413409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.414101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.414382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.414643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.415405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.416907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.440296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 149/287] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:11 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:11.452332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.471079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.489299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e90636-d14c-45b4-8530-96598ba8f7d4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.546843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.547947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.548636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.548636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.550276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.552008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.554130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 139/288] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:11.560053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.585114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d34f2-51c3-445c-b584-e03a1a751c8d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.633588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.638934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.639909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.640200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.640476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.641401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:11.641796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.643734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.654762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 150/289] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:11.660904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.697973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bb3ef-ff36-4eec-a119-7113c59ef6f2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.750844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.752590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.752882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.753156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1/roles/d7e8eb03691f4016af76d131e4ce3212` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.756426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f124894c75f461190896e7567aef362, user_id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1, role_id=d7e8eb03691f4016af76d131e4ce3212)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.757931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.765612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:11.781418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 140/290] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:11 2022] PUT /identity/v3/projects/8f124894c75f461190896e7567aef362/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1/roles/d7e8eb03691f4016af76d131e4ce3212 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:03:11.794342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2438c-92ba-43d3-9363-33d398d36e69 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.834315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:11.835312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:11.835588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:11.835875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] PATH_INFO: `/v3/users/83a3ddd20e0b410eb7042a38e79c9bf3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:11.837151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] RBAC: Authorizing `identity:get_user(user_id=83a3ddd20e0b410eb7042a38e79c9bf3)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:11.838644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:11.840629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 151/291] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/users/83a3ddd20e0b410eb7042a38e79c9bf3 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:11.846259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:11.963752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e068e-de50-4c36-8f42-2e4c1f07a559 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:11.983122 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:12.004071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de023-a539-4035-8b9c-b06925827810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:12.005324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de023-a539-4035-8b9c-b06925827810 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:12.005805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de023-a539-4035-8b9c-b06925827810 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:12.006296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042de023-a539-4035-8b9c-b06925827810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:12.085510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de023-a539-4035-8b9c-b06925827810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:12.086939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042de023-a539-4035-8b9c-b06925827810 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:12.190844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 141/292] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:12.196408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:12.331669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7cf6a-9008-42c1-9155-dc301d877368 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:12.382725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed611d-c968-401e-bddd-382c8f5d337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:12.383550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed611d-c968-401e-bddd-382c8f5d337b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:12.383836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed611d-c968-401e-bddd-382c8f5d337b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:12.384117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed611d-c968-401e-bddd-382c8f5d337b None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:12.385293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed611d-c968-401e-bddd-382c8f5d337b None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:12.386755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed611d-c968-401e-bddd-382c8f5d337b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:12.388511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 152/293] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:12 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:12.394402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de023-a539-4035-8b9c-b06925827810 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:12.439550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:12.512591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042de023-a539-4035-8b9c-b06925827810 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:12.549672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:12.550337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:12.550617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:12.550887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:12.551844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=8f124894c75f461190896e7567aef362, user.id=83a3ddd20e0b410eb7042a38e79c9bf3) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:12.552161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:12.553654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a38ed-843a-40bc-9db0-4b11b27a6cbc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:12.560244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 142/294] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:12 2022] GET /identity/v3/role_assignments?user.id=83a3ddd20e0b410eb7042a38e79c9bf3&scope.project.id=8f124894c75f461190896e7567aef362&role.id=4c771a108e9842478e33bd28c8b41844 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:13.751765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29fed-0ebe-415d-bd0a-f05c7956d98e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:13.752338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29fed-0ebe-415d-bd0a-f05c7956d98e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:13.752338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c29fed-0ebe-415d-bd0a-f05c7956d98e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:13.753972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 153/295] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:13.761354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9077d-c0c7-4c82-8ef1-18690e9dd0b7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:13.761949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9077d-c0c7-4c82-8ef1-18690e9dd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:13.761949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9077d-c0c7-4c82-8ef1-18690e9dd0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:13.779859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5bc9077d-c0c7-4c82-8ef1-18690e9dd0b7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:13.781076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5bc9077d-c0c7-4c82-8ef1-18690e9dd0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:13.859264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 143/296] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:13.878638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29fed-0ebe-415d-bd0a-f05c7956d98e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:13.894676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:13.986874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c29fed-0ebe-415d-bd0a-f05c7956d98e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.003446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe82e-9522-4a9b-89da-aee95af3d411 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.003715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe82e-9522-4a9b-89da-aee95af3d411 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.003922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfe82e-9522-4a9b-89da-aee95af3d411 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.005755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 144/297] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:14.015505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.015787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.016158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.026447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.027364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.027695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.027969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.034998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:14.036414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:14.040304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:14.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:14.049175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:14.049940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 154/298] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:14.052755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.055901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.142293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.146767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 145/299] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:03:14.170710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.177036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b41d47-da6e-44f1-b431-3e33a94fa024 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.226967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.228624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.229061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.229772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.230761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:14.231561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:14.233873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:14.249914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 155/300] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:14.251392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.294436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee689df3-e2f3-46fc-a365-207206ef249a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.330974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a508ad-c1c7-4b99-80d5-408669b91605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.331916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a508ad-c1c7-4b99-80d5-408669b91605 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.332195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a508ad-c1c7-4b99-80d5-408669b91605 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.332463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a508ad-c1c7-4b99-80d5-408669b91605 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.341074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.344352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a508ad-c1c7-4b99-80d5-408669b91605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-19a508ad-c1c7-4b99-80d5-408669b91605 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:14.352848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:14.353898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 146/301] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:14.359397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ea33-9b7a-4925-9cfd-180a32ff4a25 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.360100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ea33-9b7a-4925-9cfd-180a32ff4a25 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.360100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ea33-9b7a-4925-9cfd-180a32ff4a25 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.361388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 147/302] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:14.362143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ea33-9b7a-4925-9cfd-180a32ff4a25 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.368720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10a632-5dc6-4df1-8ed5-6aafa7539f58 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.408894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5c9b5-a20f-4e00-9de4-2e0c9606c3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.409777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5c9b5-a20f-4e00-9de4-2e0c9606c3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.410059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5c9b5-a20f-4e00-9de4-2e0c9606c3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.410390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5c9b5-a20f-4e00-9de4-2e0c9606c3e0 None admin] PATH_INFO: `/v3/users/559768284137429482533b16379c2fb5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.411712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5c9b5-a20f-4e00-9de4-2e0c9606c3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=559768284137429482533b16379c2fb5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:14.413195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5c9b5-a20f-4e00-9de4-2e0c9606c3e0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:14.414852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 156/303] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/users/559768284137429482533b16379c2fb5 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:14.416018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddcbaa-3b7d-412d-b434-a771faf6d085 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.416278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddcbaa-3b7d-412d-b434-a771faf6d085 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.416566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddcbaa-3b7d-412d-b434-a771faf6d085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.422170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.435036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0cddcbaa-3b7d-412d-b434-a771faf6d085 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:14.436255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0cddcbaa-3b7d-412d-b434-a771faf6d085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:14.468179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ea33-9b7a-4925-9cfd-180a32ff4a25 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.500574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.501243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.501525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.501798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.502548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:14.502857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:14.503916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 157/304] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:14.504299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a362a9-b817-492d-9345-39b2507b5c71 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:14.505344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4b50-a794-4471-9a9c-792a2bbfa799 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.505634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4b50-a794-4471-9a9c-792a2bbfa799 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.505900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b4b50-a794-4471-9a9c-792a2bbfa799 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.507330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 158/305] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:14.507872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4b50-a794-4471-9a9c-792a2bbfa799 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.513260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 148/306] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:14.514466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.514753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.515030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.537228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:14.538426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:14.595672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.607052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 149/307] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:14.608282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.621710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b4b50-a794-4471-9a9c-792a2bbfa799 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.651464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.656998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.657864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.658136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.658405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] PATH_INFO: `/v3/system/users/559768284137429482533b16379c2fb5/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.659858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=559768284137429482533b16379c2fb5, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:14.661326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:14.670401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 159/308] 10.222.0.45 () {58 vars in 1334 bytes} [Wed May 25 16:03:14 2022] PUT /identity/v3/system/users/559768284137429482533b16379c2fb5/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:14.671265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.712991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553e6b3-9430-4e19-9136-5e7a61c83f41 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.749255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.750172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.750455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.750720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] PATH_INFO: `/v3/users/84880e5ec4204c63846b899d310e37a8` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.766715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=84880e5ec4204c63846b899d310e37a8)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:14.768381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:14.775657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 150/309] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/users/84880e5ec4204c63846b899d310e37a8 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:14.775657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.800655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a1467-1d0e-4484-b4c5-5026e8a8dd1c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.833814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.837927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.838817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.839085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.839386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.851071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:14.858967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:14.860060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:14.860990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 160/310] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:14.861747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.891976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904c840-3bc4-4a06-8371-52ca4315d8a4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:14.923369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:14.928766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:14.929766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:14.930050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:14.930328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:14.931519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:14.932994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:14.934718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 151/311] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:14.935565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:14.976702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddcb56-8402-43a1-9d07-1b7515ffa350 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.012694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.013392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.013670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.014868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] RBAC: Adding query filter params (role.id=d7e8eb03691f4016af76d131e4ce3212, user.id=84880e5ec4204c63846b899d310e37a8, scope.system=all) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:15.015233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.016832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.022438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 161/312] 10.222.0.45 () {56 vars in 1308 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/role_assignments?user.id=84880e5ec4204c63846b899d310e37a8&scope.system=all&role.id=d7e8eb03691f4016af76d131e4ce3212 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:15.023238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:15.052197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae6069-9f25-4061-99ad-4f933dcba176 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.086015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:15.106637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.107885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.108306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.108738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.109648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:15.110094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.111851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.122973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 152/313] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:15.128921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:15.158321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb71c98-cc70-4461-84ce-ec9c32fcb013 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.183363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:15.203143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.204223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.204685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.205160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] PATH_INFO: `/v3/groups` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.206671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.208943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.231005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 162/314] 10.222.0.45 () {60 vars in 1134 bytes} [Wed May 25 16:03:15 2022] POST /identity/v3/groups => generated 229 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:15.271295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8aaff-c1fc-4854-9af0-495a1ee3ce12 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.310467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.311448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.311733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.312011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] PATH_INFO: `/v3/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.313286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] RBAC: Authorizing `identity:get_user(user_id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.314879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.317064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 153/315] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:15 2022] GET /identity/v3/users/6d20ac4a9cb14bdfb47ad9fdbb3b51a1 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:15.322340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:15.439245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9ab0b-87d7-4225-9cfb-990ef24d32e9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.482141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.482857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.483143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.483444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.551850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:15.558547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.560747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.664561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 163/316] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:15.670274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:15.723238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:15.780452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280c25e-6cd6-4df9-86a3-0d3f4f2a7569 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.820119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2256b0-5c41-4215-a2bd-57a9338fff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.821000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2256b0-5c41-4215-a2bd-57a9338fff4d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.821282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2256b0-5c41-4215-a2bd-57a9338fff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.821552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2256b0-5c41-4215-a2bd-57a9338fff4d None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.822805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2256b0-5c41-4215-a2bd-57a9338fff4d None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.824851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2256b0-5c41-4215-a2bd-57a9338fff4d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.828034 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 154/317] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:15 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:15.833489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:15.919779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:15.936565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee8540-c6d6-4302-b379-46139063ecf3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:15.971705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:15.972378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:15.972662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:15.972936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:15.973826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] RBAC: Adding query filter params (role.id=d7e8eb03691f4016af76d131e4ce3212, scope.project.id=8f124894c75f461190896e7567aef362, user.id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:15.974083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:15.975582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f380d10-8bb1-4d96-9697-86ed74b55b5b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:15.982075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 164/318] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:15 2022] GET /identity/v3/role_assignments?user.id=6d20ac4a9cb14bdfb47ad9fdbb3b51a1&scope.project.id=8f124894c75f461190896e7567aef362&role.id=d7e8eb03691f4016af76d131e4ce3212 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:16.907428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28bb5b-9227-4445-b1fa-04dfd41f396d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:16.907980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28bb5b-9227-4445-b1fa-04dfd41f396d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:16.907980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28bb5b-9227-4445-b1fa-04dfd41f396d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:16.909592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 155/319] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:16.915016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:16.915477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:16.915661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:16.934215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:16.935484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:17.007266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 165/320] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:17.030189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28bb5b-9227-4445-b1fa-04dfd41f396d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.140318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28bb5b-9227-4445-b1fa-04dfd41f396d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.159612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:17.181700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74ccb4-6fe3-4426-b2ec-c94db8f11b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.182522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ccb4-6fe3-4426-b2ec-c94db8f11b7e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.182801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ccb4-6fe3-4426-b2ec-c94db8f11b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.183072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74ccb4-6fe3-4426-b2ec-c94db8f11b7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.194373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74ccb4-6fe3-4426-b2ec-c94db8f11b7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-0d74ccb4-6fe3-4426-b2ec-c94db8f11b7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:17.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:17.203495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:17.204277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:17.207511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 156/321] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:17.209487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.290043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:17.320420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80758b0-894d-4e6e-bb05-21d4fa1f096a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.346638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621df81-239a-4fb0-9d5a-080ab37ad4bc None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.346920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621df81-239a-4fb0-9d5a-080ab37ad4bc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.347225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621df81-239a-4fb0-9d5a-080ab37ad4bc None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.348628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 157/322] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:17.353694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.353981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.354263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.358246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.358924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.359243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.359520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.360266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:17.360572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:17.361970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:17.370645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 166/323] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:17.372346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:17.373536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:17.376023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.447578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 158/324] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:17.465750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.479750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee1d23-73a6-4a39-90ce-c08bbbb89c23 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.512267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4abfb1-afb3-4017-b32a-28d8fa9aa5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.513181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abfb1-afb3-4017-b32a-28d8fa9aa5de None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.513627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abfb1-afb3-4017-b32a-28d8fa9aa5de None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.513904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abfb1-afb3-4017-b32a-28d8fa9aa5de None admin] PATH_INFO: `/v3/users/559768284137429482533b16379c2fb5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.515144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4abfb1-afb3-4017-b32a-28d8fa9aa5de None admin] RBAC: Authorizing `identity:get_user(user_id=559768284137429482533b16379c2fb5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:17.516808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4abfb1-afb3-4017-b32a-28d8fa9aa5de None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:17.518458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 167/325] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/users/559768284137429482533b16379c2fb5 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:17.519644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ce53-8f9e-4282-aaa5-cf4e0e6ff133 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.519924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ce53-8f9e-4282-aaa5-cf4e0e6ff133 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.520221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9ce53-8f9e-4282-aaa5-cf4e0e6ff133 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.521598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 168/326] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:17.524192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ce53-8f9e-4282-aaa5-cf4e0e6ff133 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.528145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:17.571220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ef86-7af5-4848-a916-3777a0ce53c7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.578353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:17.605864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de516e-fd9c-461e-9dd3-c5b76ef1ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.606975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de516e-fd9c-461e-9dd3-c5b76ef1ee0f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.607289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de516e-fd9c-461e-9dd3-c5b76ef1ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.607564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de516e-fd9c-461e-9dd3-c5b76ef1ee0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.618739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de516e-fd9c-461e-9dd3-c5b76ef1ee0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-37de516e-fd9c-461e-9dd3-c5b76ef1ee0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:17.626430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:17.627505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:17.628469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 159/327] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:17.629254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.629254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.629406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.631109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9ce53-8f9e-4282-aaa5-cf4e0e6ff133 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.646252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:17.647437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:17.664830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.665480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.665754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.666022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.666840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] RBAC: Adding query filter params (role.id=4c771a108e9842478e33bd28c8b41844, user.id=559768284137429482533b16379c2fb5, scope.system=all) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:17.667145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:17.669135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:17.680831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 169/328] 10.222.0.45 () {56 vars in 1308 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/role_assignments?user.id=559768284137429482533b16379c2fb5&scope.system=all&role.id=4c771a108e9842478e33bd28c8b41844 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:17.681618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.727648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 160/329] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:17.743837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.759413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:17.805520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84174759-195f-4c60-a7a8-02836211da49 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.842575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.843285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.843526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.844342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.845077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:17.845379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:17.846790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:17.851190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:17.856453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 170/330] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:17.861962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.863456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2933d2-584a-42bb-949c-a573beeee29d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.911119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:17.912419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:17.912700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:17.912971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:17.914136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:17.915662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:17.917269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 161/331] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:17.923690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:17.968701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e81ec6-9fa5-48e1-b930-7117f2830ff7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:17.990661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:18.001504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:18.002392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:18.002666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:18.003230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] PATH_INFO: `/v3/users/84880e5ec4204c63846b899d310e37a8` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:18.004149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] RBAC: Authorizing `identity:get_user(user_id=84880e5ec4204c63846b899d310e37a8)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:18.005594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:18.007234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 171/332] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:17 2022] GET /identity/v3/users/84880e5ec4204c63846b899d310e37a8 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:18.012766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:18.020808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70371fe9-9f3b-4953-9eea-ed377a624607 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:18.054573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1d6d8-38cb-42cd-9243-56c720729e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:18.055270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1d6d8-38cb-42cd-9243-56c720729e27 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:18.055546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1d6d8-38cb-42cd-9243-56c720729e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:18.055812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1d6d8-38cb-42cd-9243-56c720729e27 None admin] PATH_INFO: `/v3/groups` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:18.056493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1d6d8-38cb-42cd-9243-56c720729e27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:18.057927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1d6d8-38cb-42cd-9243-56c720729e27 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:18.075038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 162/333] 10.222.0.45 () {60 vars in 1134 bytes} [Wed May 25 16:03:17 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:03:18.119632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f7565-558b-4add-a109-fe27665ae722 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:18.155266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d348fdd-0c1a-4e90-a1fa-f9a886d8e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:18.156157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d348fdd-0c1a-4e90-a1fa-f9a886d8e1a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:18.156426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d348fdd-0c1a-4e90-a1fa-f9a886d8e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:18.156695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d348fdd-0c1a-4e90-a1fa-f9a886d8e1a9 None admin] PATH_INFO: `/v3/system/users/84880e5ec4204c63846b899d310e37a8/roles/d7e8eb03691f4016af76d131e4ce3212` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:18.158235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d348fdd-0c1a-4e90-a1fa-f9a886d8e1a9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=84880e5ec4204c63846b899d310e37a8, role_id=d7e8eb03691f4016af76d131e4ce3212)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:18.159681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d348fdd-0c1a-4e90-a1fa-f9a886d8e1a9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:18.168150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 172/334] 10.222.0.45 () {58 vars in 1334 bytes} [Wed May 25 16:03:18 2022] PUT /identity/v3/system/users/84880e5ec4204c63846b899d310e37a8/roles/d7e8eb03691f4016af76d131e4ce3212 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:03:20.802856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fa619-f75b-42ef-85dd-e7f23767763a None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:20.803462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fa619-f75b-42ef-85dd-e7f23767763a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:20.803462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fa619-f75b-42ef-85dd-e7f23767763a None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:20.805052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 163/335] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:20.821141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e54ea9-bfef-41f2-9a4b-b92df03cec9e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:20.823438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e54ea9-bfef-41f2-9a4b-b92df03cec9e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:20.823926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e54ea9-bfef-41f2-9a4b-b92df03cec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:20.852838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f7e54ea9-bfef-41f2-9a4b-b92df03cec9e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:20.854367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f7e54ea9-bfef-41f2-9a4b-b92df03cec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:20.930511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:20.950744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 173/336] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:20.981854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df081-7dda-4a9c-a09d-1a054a1c88b2 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:20.982180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df081-7dda-4a9c-a09d-1a054a1c88b2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:20.982397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138df081-7dda-4a9c-a09d-1a054a1c88b2 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:20.983792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 164/337] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:20.989223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:20.989479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:20.989745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.012117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:21.013294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:21.017893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df081-7dda-4a9c-a09d-1a054a1c88b2 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:21.075814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:21.113883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 174/338] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:21.149643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:21.207897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138df081-7dda-4a9c-a09d-1a054a1c88b2 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:21.277292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:21.278638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.279129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.279649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.301242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:21.307654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0904f-665f-4927-ad77-09b52bdce155 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:21.310384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:21.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:21.312400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:21.323269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 165/339] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:21.326337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:21.341476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:21.372463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:21.373671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.374146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.374615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.392564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:21.403117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:21.404037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:21.405247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 175/340] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:21.410541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:21.471867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:21.494779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a61c4-e8e6-4864-ba12-1abf04aca836 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:21.531367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:21.532064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.532498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.532781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.533901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:21.534218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:21.536412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4f9d7-f682-410d-892e-91b3c8d7f32a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:21.556354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 166/341] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:21.557733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a06376-b656-4667-b6ae-8354230b0138 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.558037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a06376-b656-4667-b6ae-8354230b0138 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.558315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a06376-b656-4667-b6ae-8354230b0138 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.559660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 167/342] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:21.568723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fb32-fbcc-43cf-a0e1-7ddd40b9ac0d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.568983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fb32-fbcc-43cf-a0e1-7ddd40b9ac0d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.569267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0fb32-fbcc-43cf-a0e1-7ddd40b9ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.605997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ffd0fb32-fbcc-43cf-a0e1-7ddd40b9ac0d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:21.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ffd0fb32-fbcc-43cf-a0e1-7ddd40b9ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:21.617055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7646dc0-9e5b-496e-a1b9-2393733752b7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:21.662450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:21.664105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.664409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.664681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.665432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:21.665737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:21.667166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:21.680678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 176/343] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:21.681927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:21.702155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 168/344] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:21.703574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d2390-2df6-4f69-9f0f-1a134d75e5a5 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.703852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d2390-2df6-4f69-9f0f-1a134d75e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.704127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d2390-2df6-4f69-9f0f-1a134d75e5a5 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.705724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 169/345] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:21.706741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d2390-2df6-4f69-9f0f-1a134d75e5a5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:21.739098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:21.826439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73a5db2-490f-4e48-93be-39fa9b8176be None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:21.828352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:21.860732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d2390-2df6-4f69-9f0f-1a134d75e5a5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:21.869182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:21.869857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.870133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.870408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.907249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354a150-bc57-411d-a953-c2a6348f7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:21.909730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a150-bc57-411d-a953-c2a6348f7384 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.910223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a150-bc57-411d-a953-c2a6348f7384 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.910704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354a150-bc57-411d-a953-c2a6348f7384 None admin] PATH_INFO: `/v3/users/84880e5ec4204c63846b899d310e37a8` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.912836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a150-bc57-411d-a953-c2a6348f7384 None admin] RBAC: Authorizing `identity:get_user(user_id=84880e5ec4204c63846b899d310e37a8)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:21.915025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354a150-bc57-411d-a953-c2a6348f7384 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:21.918332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 170/346] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:03:21 2022] GET /identity/v3/users/84880e5ec4204c63846b899d310e37a8 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:21.920076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:21.920581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:21.921047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:21.941616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:21.943457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:21.975073 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:21.977360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:22.025470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.031800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 171/347] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:22.032638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.118030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 177/348] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:22.118911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.144301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.178740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f218-2d17-4481-bc48-fcf133a38418 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.223771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67febc16-4e51-421b-b9d9-f0582a1e1167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.224593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67febc16-4e51-421b-b9d9-f0582a1e1167 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.224872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67febc16-4e51-421b-b9d9-f0582a1e1167 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.225144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67febc16-4e51-421b-b9d9-f0582a1e1167 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.239257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67febc16-4e51-421b-b9d9-f0582a1e1167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:22.246417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f08027-ada3-4d67-bd0e-48555f6f103a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-67febc16-4e51-421b-b9d9-f0582a1e1167 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:22.248581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:22.249435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:22.250241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:22.251414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 172/349] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:22.252295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c6f6-0c4d-44e6-8428-20cef389d69f None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.252578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c6f6-0c4d-44e6-8428-20cef389d69f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.252853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207c6f6-0c4d-44e6-8428-20cef389d69f None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.254664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 173/350] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:22.255409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207c6f6-0c4d-44e6-8428-20cef389d69f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.296623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.297781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.298071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.298347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.300036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] RBAC: Adding query filter params (role.id=d7e8eb03691f4016af76d131e4ce3212, user.id=84880e5ec4204c63846b899d310e37a8, scope.system=all) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:22.300356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:22.301821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:22.312947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.321717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 178/351] 10.222.0.45 () {56 vars in 1308 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/role_assignments?user.id=84880e5ec4204c63846b899d310e37a8&scope.system=all&role.id=d7e8eb03691f4016af76d131e4ce3212 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:22.322586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.380096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207c6f6-0c4d-44e6-8428-20cef389d69f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.427587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.428576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.428934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.429293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.431824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.444195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:22.454884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:22.455894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:22.456724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 174/352] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:22.457367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.458542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde64f04-5f76-421b-bcd6-21e6b2658679 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.508689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c63529-a679-4508-b001-c57db608be98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.509808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63529-a679-4508-b001-c57db608be98 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.510093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63529-a679-4508-b001-c57db608be98 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.510369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c63529-a679-4508-b001-c57db608be98 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.512782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c63529-a679-4508-b001-c57db608be98 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:22.514298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c63529-a679-4508-b001-c57db608be98 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:22.516426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 179/353] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:22.517704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.517993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.518265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.546577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:22.547993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:22.603570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e363507-44db-447b-9f76-4840af68fc72 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.621559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.631436 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 180/354] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:22.632415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.651285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.652507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.652793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.653067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.653835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:22.654136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:22.655893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:22.670808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 175/355] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:22.671939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.742167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.750061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3b95c-cc40-4a33-8d74-5f0fa0fe1ef5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.788727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.789893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.790643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.790643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.791715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:22.791715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:22.793397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:22.794398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a009c14b-6a8b-41d0-87d1-254f1bb80740 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.803081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 181/356] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:22.803792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.830808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.831669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.831951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.832177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.840419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:22.842407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:22.845272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 176/357] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:22.846257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:22.867873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:22.915939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66694c8-6c41-4566-a51f-e50ad14c9fea None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.955191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150ed6-8e1a-4a47-aaf8-454e6b20907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:22.956027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150ed6-8e1a-4a47-aaf8-454e6b20907f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.956730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150ed6-8e1a-4a47-aaf8-454e6b20907f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.957010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150ed6-8e1a-4a47-aaf8-454e6b20907f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.970831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150ed6-8e1a-4a47-aaf8-454e6b20907f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:22.975781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d74b62-c634-4b86-acd7-ca6e2a6a63df None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-58150ed6-8e1a-4a47-aaf8-454e6b20907f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:22.980408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:22.981297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:22.982083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 182/358] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:22.983275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d360-4a44-46a8-b9dc-9d62d04ca502 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:22.983391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d360-4a44-46a8-b9dc-9d62d04ca502 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:22.983931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d360-4a44-46a8-b9dc-9d62d04ca502 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:22.985050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 183/359] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:22.985698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436d360-4a44-46a8-b9dc-9d62d04ca502 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.006167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.027212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.027212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.027212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.027212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.107128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:23.108676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:23.110497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436d360-4a44-46a8-b9dc-9d62d04ca502 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.130726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.151859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.152662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.152943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.153217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.229246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:23.230670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:23.234018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 177/360] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:23.234018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.259341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.358697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f8827-62ab-4a27-b009-c743d935a92a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.362579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 184/361] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:23.364398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.385082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.397169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.397849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.398131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.398758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.399638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=961fffd1adbf452ab949876aa5822690) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:23.399951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:23.401403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c0ac-38f4-429a-8866-e72507fc9f76 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:23.407925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 178/362] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=4c771a108e9842478e33bd28c8b41844 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:23.409221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.409512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.409782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.430475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:23.431841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:23.494992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c65f08-663b-47ff-8ff3-853658884769 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.518678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 179/363] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:23.520744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.538133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.539409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.540168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.540571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.540840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.541609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:23.541991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:23.545067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:23.559207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 185/364] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:23.559207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.662212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.664927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c3edb-5586-44b0-b294-6a79dd3ed13c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.689424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd43fbf-b121-46b5-85db-d6c7b6a48413 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.713815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.714723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.714998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.715736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.719253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:23.720739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:23.722484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 180/365] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:23.724227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.736665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.737560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.737840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.738111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.739363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:23.740818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:23.742683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 186/366] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:23.747253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.837175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:23.865799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac66c5-be55-4d29-9755-7781040bc388 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.870604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b0b09-fee6-481c-9384-fcea31d82cc2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:23.911411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.912231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.912512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.912775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.913040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:23.913697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:23.913977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:23.914248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:23.924546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:23.931919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:23.932824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:23.933683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:23.938265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 181/367] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:23.939030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:23.943537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.016525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.017992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.087952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c097be-aace-473d-b03d-5d8285b0247c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.128642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.129527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.129803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.130073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.131319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.132793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.134772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 182/368] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.135573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.148321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.150930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 187/369] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:24.154851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.200867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.245698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ade7df-8b1f-4e5f-955e-02c4824bc632 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.255493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5084dc-f976-435c-826b-5486b8a965d9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.281841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.282708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.282982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.283415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.284436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.286305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.287973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 183/370] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.291081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.291788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.292069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.292334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.293508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:24.293782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.293968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.295382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.308730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 188/371] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.308730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.381114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.403714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51f5d-8a8a-4c51-be32-27a85a1130d5 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.410775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f11fd-1c48-4d68-b13d-70f3648c85e1 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.420615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.438431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.439093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.439408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.439681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.440509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=8f124894c75f461190896e7567aef362) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:24.440822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.442337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.447656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.447776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 184/372] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=8f124894c75f461190896e7567aef362&role.id=4c771a108e9842478e33bd28c8b41844 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.455608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.455797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.455899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.455899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.458048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.458048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.460049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 189/373] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.460927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.575085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b5621-f00c-45d9-ad02-22bc111acc43 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.584820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11f962-f2d8-4886-bfce-0722eb1652dc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.614051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.614723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.615007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.615331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.633799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.634639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.635043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.635369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.636489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=961fffd1adbf452ab949876aa5822690) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:24.636813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.638689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.647005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 185/374] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.648254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.662015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.678263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:24.720937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.722604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.820963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0d36d-bf36-4ebd-8184-da79e038a498 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:24.855906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 190/375] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:24.858209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.906567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:24.907489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:24.907774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:24.908046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:24.909221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:24.910699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:24.912702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 186/376] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:24.918413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:24.977373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:25.014639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a137b0-7499-4af2-a63e-19e3087095e3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:25.056242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:25.057285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:25.058024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:25.058474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] PATH_INFO: `/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:25.059746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e50e9a5bbf7f4ed0b472df8cdb0192de)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:25.061223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:25.064100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 191/377] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:25.069452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:25.089744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:25.141894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884f331-5f19-49eb-9ae6-7fda8ccaebab None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:25.179196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:25.180237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:25.180717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:25.181208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:25.182248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=8f124894c75f461190896e7567aef362) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:25.182766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:25.184628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:25.191028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 187/378] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:24 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=8f124894c75f461190896e7567aef362&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 260 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:25.221286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12191739-730a-4532-807f-6d58d19578c1 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:25.262823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033d8dc-ca3f-484d-8b66-e80407a5df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:25.263811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d8dc-ca3f-484d-8b66-e80407a5df0d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:25.264109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d8dc-ca3f-484d-8b66-e80407a5df0d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:25.264373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033d8dc-ca3f-484d-8b66-e80407a5df0d None admin] PATH_INFO: `/v3/groups/912d60442ef7497b974aeef4c226f7d2` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:25.273449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033d8dc-ca3f-484d-8b66-e80407a5df0d None admin] RBAC: Authorizing `identity:get_group(group_id=912d60442ef7497b974aeef4c226f7d2)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:25.275315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033d8dc-ca3f-484d-8b66-e80407a5df0d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:25.277870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 192/379] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:25 2022] GET /identity/v3/groups/912d60442ef7497b974aeef4c226f7d2 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:25.283765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:25.416935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2438-a79a-4037-8b01-859e18b6ebd7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:25.467659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:25.468727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:25.469230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:25.469701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:25.470777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] RBAC: Adding query filter params (group.id=912d60442ef7497b974aeef4c226f7d2, role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=e50e9a5bbf7f4ed0b472df8cdb0192de) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:25.471323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:25.473018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d687-a43d-4978-8aaa-9f0ae64f01b3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:25.479782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 188/380] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:25 2022] GET /identity/v3/role_assignments?group.id=912d60442ef7497b974aeef4c226f7d2&scope.project.id=e50e9a5bbf7f4ed0b472df8cdb0192de&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:25.903816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ff92-bc09-4061-8a14-1d710c607c9a None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:25.904231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ff92-bc09-4061-8a14-1d710c607c9a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:25.904405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8ff92-bc09-4061-8a14-1d710c607c9a None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:25.906018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 193/381] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:25.911059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:25.911523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:25.911617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:25.916805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:25.931220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:25.932403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:26.021089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 189/382] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:26.049652 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ff92-bc09-4061-8a14-1d710c607c9a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:26.062516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:26.176866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8ff92-bc09-4061-8a14-1d710c607c9a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:26.224768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:26.225597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:26.225873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:26.226141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:26.236863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:26.244627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:26.245506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:26.246401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 194/383] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:26.253019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:26.393925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e927e1-2f14-4b95-9049-67c7440603e7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:26.435809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:26.447144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:26.447861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:26.448144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:26.448414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:26.449223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:26.449529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:26.450912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:26.462979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 190/384] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:26.472294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:26.558999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:26.605898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca65f7-954e-499c-811b-3609605590de None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:26.650832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:26.651752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:26.652075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:26.652351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:26.655841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:26.657571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:26.660907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 195/385] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:26 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:26.666828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:26.804502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9997-24c1-4e0a-bd3a-6399c5fc1c96 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:26.858168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa6e63-e8c6-45e8-a025-81aece689c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:26.859069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa6e63-e8c6-45e8-a025-81aece689c3c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:26.859364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa6e63-e8c6-45e8-a025-81aece689c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:26.859643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa6e63-e8c6-45e8-a025-81aece689c3c None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:26.860830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa6e63-e8c6-45e8-a025-81aece689c3c None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:26.862282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa6e63-e8c6-45e8-a025-81aece689c3c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:26.864363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 191/386] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:26 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:26.869779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:27.024492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad71c9-42da-42fb-86c8-8c4d91706367 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:27.085794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2bfff-ec70-4c32-8375-45a82564a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:27.086688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2bfff-ec70-4c32-8375-45a82564a865 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.086965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2bfff-ec70-4c32-8375-45a82564a865 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.087260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2bfff-ec70-4c32-8375-45a82564a865 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.092559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2bfff-ec70-4c32-8375-45a82564a865 None admin] RBAC: Authorizing `identity:create_grant(project_id=961fffd1adbf452ab949876aa5822690, group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:27.094007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2bfff-ec70-4c32-8375-45a82564a865 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:27.100382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:27.116077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 196/387] 10.222.0.45 () {58 vars in 1442 bytes} [Wed May 25 16:03:26 2022] PUT /identity/v3/projects/961fffd1adbf452ab949876aa5822690/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:27.151126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b392-7443-4263-a1bb-f690926e8df2 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.152164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b392-7443-4263-a1bb-f690926e8df2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.152634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849b392-7443-4263-a1bb-f690926e8df2 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.154349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 192/388] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:27.160850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d81092-6aaf-4071-96c6-8a4e801c350a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.161439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d81092-6aaf-4071-96c6-8a4e801c350a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.161918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d81092-6aaf-4071-96c6-8a4e801c350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.188421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f8d81092-6aaf-4071-96c6-8a4e801c350a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:27.189929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f8d81092-6aaf-4071-96c6-8a4e801c350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:27.274271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 197/389] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:27.297556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b392-7443-4263-a1bb-f690926e8df2 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:27.384804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:27.425164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b0f42-9a1f-46c7-977a-0f41c7ee68d9 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.425490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b0f42-9a1f-46c7-977a-0f41c7ee68d9 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.425717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b0f42-9a1f-46c7-977a-0f41c7ee68d9 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.427586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 198/390] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:27.433998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.434585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.435075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.445396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849b392-7443-4263-a1bb-f690926e8df2 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:27.464586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:27.465525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:27.500548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:27.501717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.502183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.502659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.523610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:27.532348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:27.533238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:27.534021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:27.544550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 193/391] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:27.555412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:27.618683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 199/392] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:27.649145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:27.715183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b8720-037d-4d6c-bb54-d907ad8330c1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:27.758664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:27.762430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:27.800522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:27.801242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.801527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.801803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.802595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:27.802905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:27.804347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:27.807801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6ec40-cbb9-4c71-82af-64ab8c67389f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:27.825921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 194/393] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:27.832899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:27.846677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:27.847635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:27.847918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:27.848198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:27.859503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:27.867855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:27.868723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:27.869491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 200/394] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:27.874694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:27.992432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098ca61-831f-4db7-9b30-b78c9b3f85a5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.011724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.036458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.037167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.037450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.037724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.038566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:28.038877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.040451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.052465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 201/395] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:28.061219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.104423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eefae4-15af-4067-ab26-2dc0109c15d6 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.176490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.177368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.177647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.177922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.179903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.181371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.183031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 195/396] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:27 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:28.188740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.266373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37205d-23de-4b67-ba03-2851eb6c2ad0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.280665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.303375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d340bce-0ee7-468e-86fa-ada81b78846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.304248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d340bce-0ee7-468e-86fa-ada81b78846a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.304525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d340bce-0ee7-468e-86fa-ada81b78846a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.304797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d340bce-0ee7-468e-86fa-ada81b78846a None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.305996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d340bce-0ee7-468e-86fa-ada81b78846a None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.307508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d340bce-0ee7-468e-86fa-ada81b78846a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.309583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 202/397] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:28.310767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f431a-6cfb-4433-b4d9-9598c16e692e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.311052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f431a-6cfb-4433-b4d9-9598c16e692e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.311353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f431a-6cfb-4433-b4d9-9598c16e692e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.312703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 203/398] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:28.316809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29854-cd02-4120-827e-0f38365d63a6 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.317131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29854-cd02-4120-827e-0f38365d63a6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.317891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f29854-cd02-4120-827e-0f38365d63a6 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.319578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 204/399] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:28.320150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f29854-cd02-4120-827e-0f38365d63a6 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.341011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be026fe-8fe9-4b7b-ab15-0fda214da33f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.373622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.376130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bce764-8bb0-40ea-96b5-58aaf4182b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.377009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bce764-8bb0-40ea-96b5-58aaf4182b82 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.377289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bce764-8bb0-40ea-96b5-58aaf4182b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.377560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bce764-8bb0-40ea-96b5-58aaf4182b82 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.378962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bce764-8bb0-40ea-96b5-58aaf4182b82 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.380465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bce764-8bb0-40ea-96b5-58aaf4182b82 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.386607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 196/400] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:28.386607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8bba-75db-46df-856a-ac842070f6f4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.386607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8bba-75db-46df-856a-ac842070f6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.386607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd8bba-75db-46df-856a-ac842070f6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.400419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-30bd8bba-75db-46df-856a-ac842070f6f4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:28.401608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-30bd8bba-75db-46df-856a-ac842070f6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:28.440698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f29854-cd02-4120-827e-0f38365d63a6 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.482205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 197/401] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:28.483680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.484078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.484475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.485150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.486481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.486964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.487402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.488846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.490486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.492480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 205/402] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:28.498143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.504205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:28.505401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:28.553591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.576749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 198/403] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:28.577971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.614704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b82fe-179b-4ee6-aaf0-de84401de6ca None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.629973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.650981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.652030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.652321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.652594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.654531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] RBAC: Authorizing `identity:create_grant(project_id=8f124894c75f461190896e7567aef362, group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.656037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.668969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 206/404] 10.222.0.45 () {58 vars in 1442 bytes} [Wed May 25 16:03:28 2022] PUT /identity/v3/projects/8f124894c75f461190896e7567aef362/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:28.669766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.704218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37b7b-83ac-4125-af7b-87dc70b95c40 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.751558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.752313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.752593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.752863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.755619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] RBAC: Authorizing `identity:create_grant(project_id=961fffd1adbf452ab949876aa5822690, group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:28.757100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:28.775655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 199/405] 10.222.0.45 () {58 vars in 1442 bytes} [Wed May 25 16:03:28 2022] PUT /identity/v3/projects/961fffd1adbf452ab949876aa5822690/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/6e9210d695b14e9bb259dbc706a59244 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:28.783762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.798702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58e4c0-196e-4adc-acce-ee10f88c125b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.835466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.837190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.838251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.838786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.840002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.852602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:28.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:28.861771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:28.862537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:28.865606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 207/406] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:28.872350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:28.915771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59540a-8bb4-4575-aef7-352761fb7093 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:28.930174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:28.961315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b384-f312-4045-9578-617044c56008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:28.962219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b384-f312-4045-9578-617044c56008 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:28.962561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b384-f312-4045-9578-617044c56008 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:28.963085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b384-f312-4045-9578-617044c56008 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:28.976664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3b384-f312-4045-9578-617044c56008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-aca3b384-f312-4045-9578-617044c56008 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:28.985579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:28.986541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:28.987329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 200/407] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:28.993690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b384-f312-4045-9578-617044c56008 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.013393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6920-5a62-4f00-99bf-56d48b4f5c08 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.052649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.053683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.054134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.054574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.055543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:29.056016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.057606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.067308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 208/408] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:29.081572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.123443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:29.128164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b384-f312-4045-9578-617044c56008 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.176004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391101d-5157-4011-8472-4b79953c811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.177183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391101d-5157-4011-8472-4b79953c811c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.177785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391101d-5157-4011-8472-4b79953c811c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.177785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391101d-5157-4011-8472-4b79953c811c None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.179064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391101d-5157-4011-8472-4b79953c811c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:29.179527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391101d-5157-4011-8472-4b79953c811c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.181822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391101d-5157-4011-8472-4b79953c811c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.191665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 201/409] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:29.200613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391101d-5157-4011-8472-4b79953c811c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.216815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:29.231211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24c495-7484-44e1-9954-f9e3b9c328b6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.307981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.308926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.309207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.309480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] PATH_INFO: `/v3/groups/912d60442ef7497b974aeef4c226f7d2` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.311879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=912d60442ef7497b974aeef4c226f7d2)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.313356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.315179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 209/410] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:29 2022] GET /identity/v3/groups/912d60442ef7497b974aeef4c226f7d2 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:29.322134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391101d-5157-4011-8472-4b79953c811c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.324322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.389699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.390506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.390783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.391056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.392342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.393793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.396700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 202/411] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:29 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:29.402306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.472893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:29.529381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2f34f-4a0c-4045-97bf-4c6f8cb3a6c0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.582887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4642a-0aa1-4401-9e5f-585cbcde789d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.619708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.620658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.620956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.621230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.622443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.624314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.626348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 203/412] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:29 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:29.632016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.664554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.665372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.665644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.665914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] PATH_INFO: `/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.667106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] RBAC: Authorizing `identity:get_project(project_id=e50e9a5bbf7f4ed0b472df8cdb0192de)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.668988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.670970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 210/413] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:29 2022] GET /identity/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de => generated 344 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:29.680149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:29.727618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:29.734556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:29.739127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8a8c5-77f2-4362-ad85-9842da78280e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.780979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd180e-4ad9-4628-a888-1a358b195924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.782027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd180e-4ad9-4628-a888-1a358b195924 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.782387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd180e-4ad9-4628-a888-1a358b195924 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.782770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd180e-4ad9-4628-a888-1a358b195924 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.785366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd180e-4ad9-4628-a888-1a358b195924 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f124894c75f461190896e7567aef362, group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.786922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd180e-4ad9-4628-a888-1a358b195924 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.802804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfddf55-3a10-4538-9f84-04d731a68f3a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:29.803938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 204/414] 10.222.0.45 () {58 vars in 1442 bytes} [Wed May 25 16:03:29 2022] PUT /identity/v3/projects/8f124894c75f461190896e7567aef362/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b/roles/6e9210d695b14e9bb259dbc706a59244 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:29.810087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a0de-c571-423a-bcf2-f8af0c5dcb1e None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.810479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a0de-c571-423a-bcf2-f8af0c5dcb1e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.810858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472a0de-c571-423a-bcf2-f8af0c5dcb1e None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.821817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 205/415] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:29.824822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.825369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.825746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.860102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:29.861331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:29.879699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:29.880877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:29.881255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:29.881598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] PATH_INFO: `/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de/groups/912d60442ef7497b974aeef4c226f7d2/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:29.888142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=e50e9a5bbf7f4ed0b472df8cdb0192de, group_id=912d60442ef7497b974aeef4c226f7d2, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:29.889770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:29.919986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 211/416] 10.222.0.45 () {58 vars in 1442 bytes} [Wed May 25 16:03:29 2022] PUT /identity/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de/groups/912d60442ef7497b974aeef4c226f7d2/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:29.946375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 206/417] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:03:29.982320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:30.123941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:30.138287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601efab6-2a11-4ac4-a496-6f06ef821e4a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:30.180713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:30.181448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:30.181724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:30.181989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:30.193271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:30.201469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:30.202421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:30.203331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 212/418] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:30.208902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:30.320830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:30.335173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b62b77-b116-4aad-ba1e-7a7cae31dcb0 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:30.372637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:30.373360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:30.373638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:30.373954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:30.374703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:30.375006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:30.376415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:30.385424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 207/419] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:30.390924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:30.511907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359610a-96e7-429c-84b6-870e8301d07e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:30.564608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:30.565276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:30.565563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:30.565831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:30.591025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:30.646927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:30.648422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:30.764435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 213/420] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:03:30.770062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:30.881251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bc695-b660-43f2-a483-d1394b105f05 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:30.916935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:30.918247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:30.918529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:30.918804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:30.920067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:30.921641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:30.923641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 208/421] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:30 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:30.929306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:30.987478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:31.053114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d212bba-fa4d-4702-9877-9554841ec27e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:31.096524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34919f5c-140f-4cdf-b278-999ef1ac3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:31.097390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34919f5c-140f-4cdf-b278-999ef1ac3730 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.097848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34919f5c-140f-4cdf-b278-999ef1ac3730 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.098324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34919f5c-140f-4cdf-b278-999ef1ac3730 None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.099681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34919f5c-140f-4cdf-b278-999ef1ac3730 None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:31.101283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34919f5c-140f-4cdf-b278-999ef1ac3730 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:31.103339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 214/422] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:30 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:31.109366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:31.130185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:31.216773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5959-712d-404d-b3ce-0911febef286 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:31.258778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:31.259767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.260182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.260588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.261610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=961fffd1adbf452ab949876aa5822690) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:31.262053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:31.263667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299160b2-c925-4069-9b13-d237b111e038 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:31.270393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 209/423] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:31 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=4c771a108e9842478e33bd28c8b41844 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:31.582815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d7da6-363e-4d49-b2fe-2d675825eaf8 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.583401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d7da6-363e-4d49-b2fe-2d675825eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.583401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d7da6-363e-4d49-b2fe-2d675825eaf8 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.585085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 215/424] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:31.586708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070a41a-56c1-419c-8cd6-f757f36f0f0b None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.586997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070a41a-56c1-419c-8cd6-f757f36f0f0b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.587303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070a41a-56c1-419c-8cd6-f757f36f0f0b None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.588965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 210/425] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:31.595482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.595825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.596029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.602507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.602842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.603055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.623182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:31.623182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:31.624553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:31.625815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:31.703271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 211/426] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:31.703507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 216/427] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:31.721837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:31.726488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:31.748228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:31.788517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:31.842944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f543410-5497-49f5-8f00-569ad4724d82 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:31.847493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9724-4c36-4034-8695-3fb3e832e971 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:31.880675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:31.881649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.882033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.882367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.884450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:31.885584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:31.886055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:31.886557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:31.893840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:31.897904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:31.902184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:31.903053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:31.903903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:31.907457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 217/428] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:31.909032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:31.909872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 16:03:31.910656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:31.911286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:31.913391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 212/429] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:31.925517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.009233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.035568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5aa2-6411-477c-b9fd-57757f872c3f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.043545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295041ab-c7d9-48eb-8643-ae393ef2a0cc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.073100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.092491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.093344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.093661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.093940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.094702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:32.095009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.095116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.095907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.096283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.096460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.096773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.097673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:32.098100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.099639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.107188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 218/430] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:32.109868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 213/431] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:03:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:32.113723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.118012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.236274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5aab-e53e-4d6e-b642-286079e7f456 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.244321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de01ff-8568-4694-b4fa-2389a064ca80 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.273646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.274627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.275131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.275563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.283308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.284261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.284734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.285343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.288578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.321011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.352070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.353936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.367400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.369299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.462413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 219/432] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:32.470351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.495387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 214/433] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:32.496630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.540408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.553973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.571454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918602-4b75-46bb-a33c-998bb067396c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.607103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd0a4f-efba-4248-b155-f2d86f483053 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.607467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8eed-e520-4682-bd0a-7321a829dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.609030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8eed-e520-4682-bd0a-7321a829dc00 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.609310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8eed-e520-4682-bd0a-7321a829dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.610445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8eed-e520-4682-bd0a-7321a829dc00 None admin] PATH_INFO: `/v3/projects/961fffd1adbf452ab949876aa5822690` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.611792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8eed-e520-4682-bd0a-7321a829dc00 None admin] RBAC: Authorizing `identity:get_project(project_id=961fffd1adbf452ab949876aa5822690)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.613299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8eed-e520-4682-bd0a-7321a829dc00 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.616159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 220/434] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/projects/961fffd1adbf452ab949876aa5822690 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:32.617315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566f43-eff1-4f83-8818-c115e82b91e5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.617596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566f43-eff1-4f83-8818-c115e82b91e5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.617885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566f43-eff1-4f83-8818-c115e82b91e5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.622695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 221/435] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:32.625618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566f43-eff1-4f83-8818-c115e82b91e5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.653723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b36bc-5c64-471e-9401-4c8aebd3c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.654872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b36bc-5c64-471e-9401-4c8aebd3c497 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.655364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b36bc-5c64-471e-9401-4c8aebd3c497 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.655770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b36bc-5c64-471e-9401-4c8aebd3c497 None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.657105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b36bc-5c64-471e-9401-4c8aebd3c497 None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.658696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b36bc-5c64-471e-9401-4c8aebd3c497 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.660564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 215/436] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:32.666341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.666765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.667199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.684007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:32.685391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:32.741324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566f43-eff1-4f83-8818-c115e82b91e5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.759680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 216/437] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:32.760625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.788187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.789783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.790511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.790956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.793143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.795544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.795671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.797692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 222/438] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:32.798972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.816120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:32.864067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85dc9-2f1c-4d48-ad37-35de96a00c5c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.898101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.899233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.899506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.899775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.900921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:32.902524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:32.904221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 217/439] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:32.904973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:32.911183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178df3-5a95-4a7c-be46-a56a98faee9b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:32.945408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d9453-f79b-4223-8045-91b0369365db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:32.946203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9453-f79b-4223-8045-91b0369365db None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.946477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9453-f79b-4223-8045-91b0369365db None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.946745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d9453-f79b-4223-8045-91b0369365db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.956848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71d9453-f79b-4223-8045-91b0369365db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-e71d9453-f79b-4223-8045-91b0369365db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:32.964600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:32.965511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:32.966303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 223/440] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:32.966950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d85f-4e27-4713-912e-7828dce475ac None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:32.967325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d85f-4e27-4713-912e-7828dce475ac None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:32.967661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65d85f-4e27-4713-912e-7828dce475ac None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:32.968753 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 224/441] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:32.969434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65d85f-4e27-4713-912e-7828dce475ac None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.010103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.013361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bac008-39ba-4ef0-b259-bc9bb2140790 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.033859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.050489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.051371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.051657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.051933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.052757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=961fffd1adbf452ab949876aa5822690) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:33.053069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.054545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.071186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 218/442] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=961fffd1adbf452ab949876aa5822690&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:33.071186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.083172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65d85f-4e27-4713-912e-7828dce475ac None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.124766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.125362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.125645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.125921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.126906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=4c771a108e9842478e33bd28c8b41844, scope.project.id=8f124894c75f461190896e7567aef362) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:33.127262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.128784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a347c0d-e49f-471a-89fe-2b4418db6a61 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.135766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 225/443] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:32 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=8f124894c75f461190896e7567aef362&role.id=4c771a108e9842478e33bd28c8b41844 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:33.137381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.137736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.138083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.164489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:33.165860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:33.201894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cfeb0-1d4e-46c3-beca-227c9c2e4673 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.247953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.249648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.250153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.250604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.251622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:33.252129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.253743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.254202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 226/444] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:33.264508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 219/445] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:33.272012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.278968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.312605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.354064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.405793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572308e-14ee-46f2-be41-6c0b87cab2c1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.406241 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e95da-bfc8-4b03-89e2-253fb3a3520e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.444193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.445016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.445293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.445561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.447902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.450738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.451024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.451333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.460465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:33.468662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:33.469729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:33.471170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 220/446] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:33.476488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.532856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.534274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.576801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.594653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b99eab-2792-4969-9279-bc6fc61e3403 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.603817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.641509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.642191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.642474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.642747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.643543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:33.643961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.645340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.653116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 227/447] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:33.655250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 221/448] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:33.658715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.660140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.771173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24110234-cb41-4f61-ae6f-c4e36c5b7fbd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.772467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf113c-090f-48b3-9881-975939da41bf None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.805472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.806003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.806330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.806610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.806701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.806872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] PATH_INFO: `/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.806961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.807178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.808173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] RBAC: Authorizing `identity:get_project(project_id=e50e9a5bbf7f4ed0b472df8cdb0192de)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.809615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.811490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 228/449] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/projects/e50e9a5bbf7f4ed0b472df8cdb0192de => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:33.816786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.825901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.846422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:33.878979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.880461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.913430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f4a44-deaa-4883-b256-89ade28ff98a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:33.947264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:33.948168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:33.948421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:33.948763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] PATH_INFO: `/v3/groups/912d60442ef7497b974aeef4c226f7d2` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:33.950040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] RBAC: Authorizing `identity:get_group(group_id=912d60442ef7497b974aeef4c226f7d2)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:33.951545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:33.953145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 229/450] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/groups/912d60442ef7497b974aeef4c226f7d2 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:33.958931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:33.980706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 222/451] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 16:03:33.986140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:34.032628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:34.052495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:34.057545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34059e-c325-4c78-8654-b1af75c1b61e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:34.090097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543417-e355-4336-8984-2b7dca150b41 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:34.092657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:34.093366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:34.093646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:34.093912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:34.094730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] RBAC: Adding query filter params (group.id=912d60442ef7497b974aeef4c226f7d2, role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=e50e9a5bbf7f4ed0b472df8cdb0192de) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:34.095035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:34.096498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:34.102503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 230/452] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/role_assignments?group.id=912d60442ef7497b974aeef4c226f7d2&scope.project.id=e50e9a5bbf7f4ed0b472df8cdb0192de&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:34.125682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:34.126569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:34.126850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:34.127124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] PATH_INFO: `/v3/projects/8f124894c75f461190896e7567aef362` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:34.128440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] RBAC: Authorizing `identity:get_project(project_id=8f124894c75f461190896e7567aef362)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:34.129945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:34.131763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 223/453] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:03:33 2022] GET /identity/v3/projects/8f124894c75f461190896e7567aef362 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:34.137746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:34.249249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44300be1-65dc-4d00-8b20-04530b0dd925 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:34.284902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946c6f9-0484-4d66-9fa4-09dd6c996dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:34.285780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c6f9-0484-4d66-9fa4-09dd6c996dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:34.286056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c6f9-0484-4d66-9fa4-09dd6c996dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:34.286316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946c6f9-0484-4d66-9fa4-09dd6c996dd1 None admin] PATH_INFO: `/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:34.287561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946c6f9-0484-4d66-9fa4-09dd6c996dd1 None admin] RBAC: Authorizing `identity:get_group(group_id=6bdb3e5886ab45f5ba7ce2d91b54e15b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:34.289054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946c6f9-0484-4d66-9fa4-09dd6c996dd1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:34.290659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 231/454] 10.222.0.45 () {56 vars in 1180 bytes} [Wed May 25 16:03:34 2022] GET /identity/v3/groups/6bdb3e5886ab45f5ba7ce2d91b54e15b => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:34.297114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:34.397969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b1562-f389-43ce-a7ed-974a0bd5ea5a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:34.414458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:34.434736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:34.435409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:34.435685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:34.435956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:34.436784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] RBAC: Adding query filter params (group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b, role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=8f124894c75f461190896e7567aef362) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:34.437097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:34.438532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea110-686c-447a-8eee-101afd76c476 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:34.444462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 224/455] 10.222.0.45 () {56 vars in 1376 bytes} [Wed May 25 16:03:34 2022] GET /identity/v3/role_assignments?group.id=6bdb3e5886ab45f5ba7ce2d91b54e15b&scope.project.id=8f124894c75f461190896e7567aef362&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:37.285382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e7215-f59d-4027-a38d-1e3ae0b5f36b None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.285912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e7215-f59d-4027-a38d-1e3ae0b5f36b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.285912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e7215-f59d-4027-a38d-1e3ae0b5f36b None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.287578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 232/456] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:37.293259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea3d98-5fa7-4cc5-ac4e-e1b2724b9c4d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.293709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea3d98-5fa7-4cc5-ac4e-e1b2724b9c4d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.293809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea3d98-5fa7-4cc5-ac4e-e1b2724b9c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.320470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-93ea3d98-5fa7-4cc5-ac4e-e1b2724b9c4d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:37.321612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-93ea3d98-5fa7-4cc5-ac4e-e1b2724b9c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:37.416963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 225/457] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:37.465419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e7215-f59d-4027-a38d-1e3ae0b5f36b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:37.509237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:37.587994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e7215-f59d-4027-a38d-1e3ae0b5f36b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:37.596262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2b51-d6a5-4a85-8aee-817d842ad596 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.596761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2b51-d6a5-4a85-8aee-817d842ad596 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.597170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a2b51-d6a5-4a85-8aee-817d842ad596 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.606219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 226/458] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:37.608742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.609022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.609293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.637612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:37.638458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.638732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.638998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.654744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:37.655996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:37.660412 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:37.661908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:37.695377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:37.696300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:37.697216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:37.697216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:37.697216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:37.697216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:37.707634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 233/459] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:37.708655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:37.734213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 227/460] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:37.759214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:37.807520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:37.861752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf906e-3c88-41c8-ba5a-46ecef6b3bd5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:37.890458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e47f2-0516-4475-b7d7-748f651ee9cd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:37.896965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:37.898038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.898508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.898982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.912922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:37.916013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:37.924815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:37.928279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:37.928947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.929228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.929501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.930220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:37.930527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:37.932975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455da02-8d23-4d5d-bdbd-5ed67f8cb494 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:37.945606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 234/461] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:37.946977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d679ca-1988-42c6-8ee7-19258e8e5112 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.947298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d679ca-1988-42c6-8ee7-19258e8e5112 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.947563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d679ca-1988-42c6-8ee7-19258e8e5112 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.952850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 235/462] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:37.952850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2cab3-d885-4a27-a279-788203d30c03 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.952850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2cab3-d885-4a27-a279-788203d30c03 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.953074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2cab3-d885-4a27-a279-788203d30c03 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.954275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 236/463] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:37.954845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2cab3-d885-4a27-a279-788203d30c03 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-4895dd06-0cb3-48cc-842f-2f855a286d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:37.956685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:37.957498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:37.958350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:37.958350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:37.958350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:37.958350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:37.963015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 228/464] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:37.963015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b190-6119-4560-b1f4-5706bcb02507 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:37.963015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b190-6119-4560-b1f4-5706bcb02507 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:37.963015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b190-6119-4560-b1f4-5706bcb02507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:37.990193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dd88b190-6119-4560-b1f4-5706bcb02507 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:37.992151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dd88b190-6119-4560-b1f4-5706bcb02507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:38.068068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2cab3-d885-4a27-a279-788203d30c03 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.099723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 229/465] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:38.101647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.101934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.102209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.118531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:38.119681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:38.121142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.122397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.123564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.123852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.124630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.127635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.141362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:38.144269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:38.149805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 237/466] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:37 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:38.150809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.209053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 230/467] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:38.215493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.295447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16559093-396e-4b51-85f3-c80e8366f98b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.342145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.343887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.344342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.345065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.345956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:38.346664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.349007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.350360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c84be-91b9-44c2-85fc-b57ae3f6f7a8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.370303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 238/468] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:38.370303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.396669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.397761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.398191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.398462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.409861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.411741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:38.430666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:38.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:38.432406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:38.432406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:38.432406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:38.432406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:38.433415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 231/469] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:38.433687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.439290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:38.440326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:38.490162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697fdd4-7fdc-4ccb-94ce-c912c143f07e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.526998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.528058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.528167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.528404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.539269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.540462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:38.559022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:38.559956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:38.560791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:38.560791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:38.560791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:38.560791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:38.560791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 239/470] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:38.561474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.572219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667cee73-13ed-4d69-b810-91ae55d01fac None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.619004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.620074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.621118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.621621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.622797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.625430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.651683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 232/471] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:38 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:38.652623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.722446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fc107-dfb6-4c50-a57a-43872ea0ca60 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.746656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:38.773934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:38.800749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.806979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.807338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.807613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.808357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:38.808661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.810385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.836365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df3d1b-5649-4af2-90c6-3a617c2a1fb7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:38.846889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 240/472] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:38.855453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.895638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:38.896927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.898289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.898761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.899688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:38.900164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:38.901760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0bcf1-2522-4d56-9e70-f77fba5f390e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:38.917348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 233/473] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:38.919338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250b64-5eb1-429a-9390-20be1df8c099 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:38.919623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250b64-5eb1-429a-9390-20be1df8c099 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:38.919897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a250b64-5eb1-429a-9390-20be1df8c099 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:38.921476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 234/474] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:38.924991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250b64-5eb1-429a-9390-20be1df8c099 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:38.987065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee790c6b-b835-4caa-998a-2b2f9251b2ae None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:39.028779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cda78-feb6-43be-bf7b-21389c9fc80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:39.029610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cda78-feb6-43be-bf7b-21389c9fc80f None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:39.029904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cda78-feb6-43be-bf7b-21389c9fc80f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:39.030542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cda78-feb6-43be-bf7b-21389c9fc80f None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:39.031543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cda78-feb6-43be-bf7b-21389c9fc80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:39.033537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cda78-feb6-43be-bf7b-21389c9fc80f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:39.054063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a250b64-5eb1-429a-9390-20be1df8c099 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:39.068750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 241/475] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:38 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:39.083197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:39.083197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:39.083197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:39.098989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:39.119060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:39.119830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:39.120114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:39.120386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:39.121320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:39.122283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:39.122894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:39.123990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:39.155798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 235/476] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:38 2022] POST /identity/v3/users => generated 249 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:39.161244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:39.221524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 242/477] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:39.256545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:39.376133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005ab50-118f-41ee-a01b-18b7cc3eddc8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:39.414867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:39.415585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:39.415864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:39.416194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:39.416974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:39.418875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:39.427235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.sql.core [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 16:03:39.427235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 16:03:39.427235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [parameters: {'id': '2e7a5a910f854fedb05ef7a67ec0ef87', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 16:03:39.427235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80440) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application conn.query(q) May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result.read() May 25 16:03:39.444730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return ref.to_dict() May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:03:39.445640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application next(self.gen) May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application yield resource May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application next(self.gen) May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.session.rollback() May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.force_reraise() May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise self.value May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application session.commit() May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 16:03:39.446502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._prepare_impl() May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.session.flush() May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._flush(objects) May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application compat.raise_( May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application flush_context.execute() May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rec.execute(self) May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 16:03:39.447393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:03:39.448262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application conn.query(q) May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result.read() May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:03:39.449056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [parameters: {'id': '2e7a5a910f854fedb05ef7a67ec0ef87', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:39.449909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 16:03:39.450700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:39.453301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 236/478] 10.222.0.45 () {60 vars in 1131 bytes} [Wed May 25 16:03:39 2022] POST /identity/v3/roles => generated 144 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:39.453435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:39.568688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8265a7-50fd-4355-9577-e34529750d5b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:39.604992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560241a6-9716-4e0a-b6c0-ea4dbc1e7e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:39.606360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560241a6-9716-4e0a-b6c0-ea4dbc1e7e0c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:39.606834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560241a6-9716-4e0a-b6c0-ea4dbc1e7e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:39.607328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560241a6-9716-4e0a-b6c0-ea4dbc1e7e0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:39.619483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560241a6-9716-4e0a-b6c0-ea4dbc1e7e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-560241a6-9716-4e0a-b6c0-ea4dbc1e7e0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:39.628003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:39.628903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 16:03:39.629760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:39.632509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 243/479] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:03:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:39.638227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:39.686855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:39.748535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7da40b-dee1-4f11-b146-5463ca817368 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:39.785882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:39.786561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:39.786842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:39.787118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:39.787894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:39.788199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:39.789687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384608c-c26e-469d-945f-c7333ece1a6f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:39.799305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 237/480] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:40.741338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81570dc9-5ab3-44db-a3d7-2c347b47dd46 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:40.741902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81570dc9-5ab3-44db-a3d7-2c347b47dd46 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:40.741902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81570dc9-5ab3-44db-a3d7-2c347b47dd46 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:40.743553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 244/481] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:40.749004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:40.749398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:40.749589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:40.775318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:40.776578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:40.873950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 238/482] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:40.914910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81570dc9-5ab3-44db-a3d7-2c347b47dd46 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:40.938999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:41.060840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81570dc9-5ab3-44db-a3d7-2c347b47dd46 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:41.122596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:41.123441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.123724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.123996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.142873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:41.150657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:41.151558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:41.152338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 245/483] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:41.157993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:41.216261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:41.302955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e64933-305f-41d4-9d4e-4a819ce3eacd None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:41.356995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:41.357592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.357869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.358138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.358901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:41.359212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:41.360603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d77fc-ad26-4a23-837b-f6f5ebbae0ca None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:41.373907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 239/484] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:41.380284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:41.392626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188293ae-cd0f-4eec-9604-2bea8c18e275 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.392913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188293ae-cd0f-4eec-9604-2bea8c18e275 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.393172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188293ae-cd0f-4eec-9604-2bea8c18e275 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.394902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 240/485] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:41.401780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.402059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.402330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.424611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:41.425797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:41.497606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 241/486] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:41.541004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:41.587555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:41.589607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:41.623860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964041c-a50d-4bd1-b8fe-f08156c3cd73 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:41.664710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:41.667026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.667565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.668481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.682427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:41.684582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:41.705548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:41.706470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:41.707329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:41.707329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:41.707329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:41.707329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:41.710721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 246/487] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:41.720424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:41.723785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b80d1-1520-467c-9243-92147b7d05c4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:41.783692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:41.784564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.784849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.785156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.804197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:41.825340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:41.826290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:41.827086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 242/488] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:41.832493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:41.841427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1da38-1db0-4a2b-863c-e68f7b11e6ed None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:41.870877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:41.880684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:41.881630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:41.882108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:41.882606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:41.883564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:41.884098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:41.885679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:41.908881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 247/489] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:41.914978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.006645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.025131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf7371-033e-4c3a-bd3f-4ed0e7c0798a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.055756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df059ed3-102a-4eac-8256-3ab797785c6a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.061122 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.061801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.062082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.062356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.065742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:42.065742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.065742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156892-930b-4ca1-a261-044c7729ca65 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.073968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 243/490] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:42.077092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3f32-cdc7-4645-9a83-f28f003b64fc None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.077092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3f32-cdc7-4645-9a83-f28f003b64fc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.077092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec3f32-cdc7-4645-9a83-f28f003b64fc None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.081359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 244/491] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:42.082171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3f32-cdc7-4645-9a83-f28f003b64fc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.107756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.108900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.109376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.110001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.118529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.120550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-0082e59f-ae68-4b0a-b782-fb5533a7524e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:42.137698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:42.138630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:03:42.139983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:42.142336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 248/492] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:03:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:42.143828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.144306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.144787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.162192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:42.163944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:42.190873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec3f32-cdc7-4645-9a83-f28f003b64fc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.213000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.227368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.228497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.228985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.229355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.251179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 249/493] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:42.251395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.251488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.251568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.258224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e87e56da-10b4-49e5-8316-3ae0406a10f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:42.271855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:42.272734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:42.274010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:42.274010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:42.274010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:42.274010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:42.274010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 245/494] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:42.275086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43684fc1-c607-4d20-a891-1ad16783cfc8 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.276563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43684fc1-c607-4d20-a891-1ad16783cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.276563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43684fc1-c607-4d20-a891-1ad16783cfc8 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.278044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 246/495] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:42.279046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43684fc1-c607-4d20-a891-1ad16783cfc8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.353055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e3226-3383-4ecc-9532-49fe2828fd96 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.388649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.389257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.389526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.389810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.390639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:42.390941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.392428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8052a-bdbb-47f6-b566-1615f72754d7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.409059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43684fc1-c607-4d20-a891-1ad16783cfc8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.435075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 250/496] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:42.435075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.435075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.435075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.449606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.450132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:42.450439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.450721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.450994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.451383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:42.463112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:42.471422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:42.472336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:42.473136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 247/497] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:42.473788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.484286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.526807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 251/498] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:42.527634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.544667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.597538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b73755-c004-47a4-9af0-2a6d0a8c9b61 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.635394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.636385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.636871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.637329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.638125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:42.638505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.639984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.640334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491431-2ca9-427c-868b-d0e2de7e0ca2 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.652114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 248/499] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:42.656775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.680681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.681441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.681800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.682070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.715774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.750113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.751631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.758512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36410cf-7d5b-4df7-86fc-017744d07b26 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.779453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.801118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.801810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.802094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.802366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.803111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:42.803451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:42.804855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:42.813759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 249/500] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:42.814556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.859773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 252/501] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:42.859773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.914644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae17871-f0c2-4271-9c3b-0b914d48a848 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.920918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:42.948360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef7177-a2fe-4850-8956-6a30faaee20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.949161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7177-a2fe-4850-8956-6a30faaee20c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.949545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7177-a2fe-4850-8956-6a30faaee20c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.949811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef7177-a2fe-4850-8956-6a30faaee20c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.954567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113ec32-0f9b-4b46-b71e-2f75813a71bb None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:42.960184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef7177-a2fe-4850-8956-6a30faaee20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-eeef7177-a2fe-4850-8956-6a30faaee20c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:42.967839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:42.968729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:42.969492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 250/502] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:42.970350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c4ee-a3d2-4c51-b7fb-c0e808fedefc None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.970545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c4ee-a3d2-4c51-b7fb-c0e808fedefc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.970772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4c4ee-a3d2-4c51-b7fb-c0e808fedefc None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:42.975191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 251/503] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:42.975191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c4ee-a3d2-4c51-b7fb-c0e808fedefc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:42.997387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:42.998185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:42.998711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:42.998711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.006112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.007646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.015907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:43.022503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:43.023435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:43.024322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 253/504] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:43.028020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.076984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4c4ee-a3d2-4c51-b7fb-c0e808fedefc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.111386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.112335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.112616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.112889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.124933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.126404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.128967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58504ceb-50dd-411e-bd7a-65bcb77e2dc3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:43.145197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:43.146106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:43.151921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:43.151921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:43.151921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.151921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:43.151921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 252/505] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:43.151921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.155532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.165268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.165995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.166286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.166567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.177367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.178846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-48e7e38c-a38a-49f6-8dca-05ac3bba6699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:43.195940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:43.196777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:43.197616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:43.197616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:43.197616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.197616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:43.197616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 254/506] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:43.198595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.198878 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.199171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.215035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:43.216237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:43.246544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.256197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0798a-e529-422e-b42b-5d489e6b2fe0 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.280341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 255/507] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:43.281382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.289727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.290399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.290681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.290953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.291732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:43.292037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.293844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.302508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 253/508] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:43.303351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.393806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176cf13-0135-450f-aad5-807ec23e0b21 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.402123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094293-6e79-4e96-8c83-d245c2d2bb9f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.403078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.429099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.429728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.430016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.430294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.431137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:43.431473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.432928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.436196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.436846 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.437124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.437398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.438102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:43.438402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.439801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.450126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 256/509] 10.222.0.45 () {56 vars in 1137 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:43.450918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.452029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 254/510] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:43.452897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.468742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.553031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db394539-acef-4d8f-9dd7-53641928d978 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.554842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92436d6f-9d6e-4aed-af59-f218fbafb587 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.589518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.589963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.590732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.590842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.591019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.591291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.591382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.591787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.593017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:43.593492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.595822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.602456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.604015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.609868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 257/511] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:43.610674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:43.627331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:43.628374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:43.629432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:43.629432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:43.629432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.629432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:43.629432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 255/512] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:43.629432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.644260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.696259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.717571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadc651-f7a0-46b1-a391-e83dfd090e30 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.731503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5bd58-594d-40ce-8cc1-4f7d74fb9116 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.752109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.752975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.753258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.753529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.765024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.765901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.766497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.766601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.766810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.767111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:43.783318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:43.784335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:43.785438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:43.785438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:43.785438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:43.785438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:43.785438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 258/513] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:43.785770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.839420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.840930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.861221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.882960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c77a1-0304-430d-bdd6-957cfc406dde None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:43.903465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:43.916201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:43.916998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:43.917280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:43.917554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:43.925344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:43.926808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:43.938517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 256/514] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:43.939374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:43.940499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:43.941365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:43.942234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 259/515] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:43.942782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.042334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e061-49ef-4c29-b086-6335817ca8c1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.042530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6cdc0b-c785-4bc1-a58f-b722f31bf33d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.077364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.078170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.078449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.078539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.078719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.079198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.079488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.079762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.080490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:44.080801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.082205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.085891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.087363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.089605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.095542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 260/516] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:44.096359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:44.102029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:44.103004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 257/517] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:44.104945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.132829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.206161 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50859843-779f-49ba-9ea5-6c90c0de2899 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.209159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181b7bd-6a4a-45d8-b6fe-7e576fb7983a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.239018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.239715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.240003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.240276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.240997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:44.241303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.241889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.242693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.242795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.242967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.243266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.253717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.253884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 261/518] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:44.254682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.255526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:44.272961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:44.273820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:44.274693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:44.274693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:44.274693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:44.274693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:44.274693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 258/519] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:44.274957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.316380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.353345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.358531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267d033-4394-49eb-b24e-cc97f1168072 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.375729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575bfe8-6f03-4fda-bf70-fe45c87c13f3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.391585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.392261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.392536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.392794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.393646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:44.393955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.395422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.410420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.411084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.411393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.411661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.412264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 262/520] 10.222.0.45 () {56 vars in 1137 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:44.412392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.413057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.413807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.435251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 259/521] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:03:44 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:03:44.436189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.537336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1577d2d-9026-489f-9151-c4e22604b1f0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.558065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.569373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d497-8309-42a8-bbc0-7410876b5432 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.578621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.579341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.579619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.579892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.580687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:44.580993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.582670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.603727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 263/522] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:44.604613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.612073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.613891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.614179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.614456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.616882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.625686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.628025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:44.645225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:44.646324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:44.647534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 260/523] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:44.651819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.719958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dbdd1-f0d1-43e2-b0c7-4c12f5104317 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.754473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.755146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.755453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.755728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.756441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:44.756747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.758131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.767543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bae97-88eb-40fc-be78-b3efc92a4f19 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.770242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 264/524] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:44.771067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:44.810634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.812634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.813162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.813504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.813771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.877278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:44.883935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e16c8e-ff6b-45a8-9514-ade9ac7d8733 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:44.885757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.888351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.921672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:44.923101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:44.923424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:44.923711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:44.924546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=ff4b9a16037c4657bd7710297746ad4e) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:44.924943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:44.926404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:44.933130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 265/525] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/role_assignments?user.id=ff4b9a16037c4657bd7710297746ad4e&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:44.934027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.023365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 261/526] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:45.024717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.086826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:45.091357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cde658-fe36-4ded-a667-c6c3a2447653 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.134573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.135717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.136198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.136683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.137852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:45.138358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.140790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.142537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:45.152330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f02ae9-e0ab-43f4-a7b1-344313491cd2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.163802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 266/527] 10.222.0.45 () {56 vars in 1139 bytes} [Wed May 25 16:03:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:45.165076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.198249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.199380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.199683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.199945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.208881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.210389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:45.228306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:45.229213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:45.230064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:45.233012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 262/528] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:45.234158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.288586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2dbb6-ac4e-4151-bd4e-ad4c7ae902e2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.334111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.335194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.335481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.335757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.342464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f427d-e117-46da-9788-bcaac0b23f50 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.349102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.351085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:45.375267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:45.376129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:45.376954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:45.376954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:45.376954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:45.376954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:45.381116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 267/529] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:45.381739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.381942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.382975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.383459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.383926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.396587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:45.411733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:45.462511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.464715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.508797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacadb2-90f0-4d0c-8f36-259461b14fe0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.554598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.555390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.555677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.555947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.556742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:45.557044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.558509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.575361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 268/530] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:45.576794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.591666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 263/531] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:45.593034 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.657656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:45.672455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:45.712761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2e2a6-ea2b-4324-8f47-a6d23f8acd36 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.716207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e39be-a149-4b4b-8b68-9fee526564fd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:45.751726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.752205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:45.752894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.753176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.753422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:45.753520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.754003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:45.754168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:45.754462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.754816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:45.755858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=096d124cc0484429858b2e5f6790ecb9) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:45.755975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.756472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:45.758128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:45.765284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 264/532] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/role_assignments?user.id=096d124cc0484429858b2e5f6790ecb9&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:45.766454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.776113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 269/533] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:45.780945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:45.986571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aa329-f717-4de3-9380-890a62b7d0bd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.005499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d8979-facc-4f8d-a1f3-9c5a028b367e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.021805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:46.034026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:46.043863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.044981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.045481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.045950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.053777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.055516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.060406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.061227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.061510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.061786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:46.072309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:46.073283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:46.074107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:46.076771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 270/534] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:46.082659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:46.093726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.095260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:46.141225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:46.142151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:46.142991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:46.142991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:46.142991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:46.142991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:46.142991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 265/535] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:46.152355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:46.225469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a336f-01a7-4bd6-bf97-eb44e9562798 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.295825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.296501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.296783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.297060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.297851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:46.298160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.299670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.321916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 271/536] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:46.323194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48b360-bb9e-4512-9f86-d6abf2849755 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.328013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:46.358246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.358928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.359235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.359511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.360231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:46.360537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.361937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.375461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 266/537] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:46.386206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:46.408280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:46.431544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:46.469851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08701e-ecda-441c-8b49-5c8e1b21471c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.505817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7032eb-f236-4ce9-b14d-2f6b1d7ff49c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.540742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.541408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.541688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.542064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.543534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=9eb3714586bf4b50a1a9b29358f92b2f) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:46.544140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.545537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.545800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.546395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.546618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.546893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.552315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 272/538] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:46 2022] GET /identity/v3/role_assignments?user.id=9eb3714586bf4b50a1a9b29358f92b2f&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:46.554249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.562755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:46.578237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:46.579374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:46.580400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:46.582619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 267/539] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:46.588536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:46.759607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2c874-fc92-4fa5-a3b6-3c33739b2c3c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:46.778320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:46.800841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:46.801491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.801775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.802046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.802832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:46.803144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:46.804638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79ca5b-e018-4c53-bb24-5a1c63a81168 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:46.817977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 273/540] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:46.823697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:46.889498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4f9b-c8cb-466a-ab78-c65093d1c29b None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.889772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4f9b-c8cb-466a-ab78-c65093d1c29b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.890106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a4f9b-c8cb-466a-ab78-c65093d1c29b None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.891826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 274/541] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:46.904580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:46.905043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:46.905810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:46.942608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:46.943843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:46.985633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:47.003762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d909e39-0009-4dee-be44-9945ad414538 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:47.059224 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 275/542] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:47.079884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:47.081282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.082514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:47.087384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.089528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.090738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=99e8bd308e5549618c66d6edaf02523c) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:47.091301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:47.094001 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:47.106961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 268/543] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:46 2022] GET /identity/v3/role_assignments?user.id=99e8bd308e5549618c66d6edaf02523c&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:47.250450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22c11-8a45-4182-941c-689a5497a649 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:47.253327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:47.303751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c81b-ea58-47f1-85a3-b0ef77eefd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:47.304609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c81b-ea58-47f1-85a3-b0ef77eefd96 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.304884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c81b-ea58-47f1-85a3-b0ef77eefd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.305153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c81b-ea58-47f1-85a3-b0ef77eefd96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.326938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c81b-ea58-47f1-85a3-b0ef77eefd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-3324c81b-ea58-47f1-85a3-b0ef77eefd96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:47.334700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:47.335648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:47.336454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 276/544] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:47.342776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:47.455619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6786ce0-dfde-4c95-9583-902bb7899dce None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:47.498612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d444-bde0-4a24-bb35-69cbe89b4062 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.498938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d444-bde0-4a24-bb35-69cbe89b4062 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.499201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d444-bde0-4a24-bb35-69cbe89b4062 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.499501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:47.500393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.500830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 277/545] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:47.501062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.501538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.502499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:47.502999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:47.504611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:47.505720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.506012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.506291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.514809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 269/546] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:47.519877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:47.544234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:47.545438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:47.551514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:47.674967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672434b2-ef8c-45de-bcd0-297cfbf10f4e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:47.691009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 278/547] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:47.710633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:47.711466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.711746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.712018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.723177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:47.724642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:47.726120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:47.754748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:47.755707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:47.756616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:47.756616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:47.756616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:47.756616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:47.756616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 270/548] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:47.763849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:47.867254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:47.875230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625e9f4-8588-4ed9-becb-e0ce854c57c7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:47.909440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:47.923478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:47.924295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:47.924578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:47.924850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:47.936986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:47.945696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:47.948217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:47.949700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 279/549] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:47.957848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:47.973655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee3693-83e2-4c12-bc7e-45fa6faa8d7e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.011699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.012491 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.012777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.013052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.013772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:48.014081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.015504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.029225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 271/550] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:48.035982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.163877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da1d71-b36b-4c40-95c2-aadb3bd5c691 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.217700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.218752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.219258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.219739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.220674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:48.221191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.224085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.236171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bc779-bf7c-4346-86f1-7a306b69b1c9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.248021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 280/551] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:48.249191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.280314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:48.290913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:48.304681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.305490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.305762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.306026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.320616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.322095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e54664eb-c42e-4bbd-a8c4-8246f7bef990 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:48.340627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:48.341674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:03:48.342660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:48.346421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 272/552] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:48.347899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd441eb6-1561-47ba-a3c7-13a735154a1b None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.348182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd441eb6-1561-47ba-a3c7-13a735154a1b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.348455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd441eb6-1561-47ba-a3c7-13a735154a1b None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.354147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 273/553] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:48.354868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd441eb6-1561-47ba-a3c7-13a735154a1b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.401855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc895d8-f9a9-4234-90ed-7b6817913cb7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.436678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.437481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.437767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.438051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.448877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.450442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-4ed4e079-676f-40a0-a672-ed3d5d53447a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:48.467901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:48.468786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:48.469713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:48.469713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:48.469713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:48.469713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:48.469713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 281/554] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:48.470697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.470979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.471266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.490172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:48.491137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:48.495376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd441eb6-1561-47ba-a3c7-13a735154a1b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.539705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.540380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.540700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.540968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.541795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:48.542140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.544058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.564431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:48.579176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 282/555] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:48.579176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.597920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 274/556] 10.222.0.45 () {56 vars in 1135 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:48.599253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.659414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:48.712542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd26a4e-4139-444f-b9f5-bf0352ae14b3 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.728095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c5671-8dd8-464c-ba81-d5fca8a66e12 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.755784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.756574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.756928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.757272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.758066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:48.758439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.759929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.771457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.772268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.772543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.772809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.773346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 283/557] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:48.774205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.786725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:48.797835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:48.799207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:48.800032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 275/558] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:48.801462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:48.836036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:48.889261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5013-dbd0-42e8-a668-6126e83888ac None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.931342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5a411-24c4-46b1-8e42-3960db9c2afb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:48.935989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.936651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.936928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.937198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.939690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:48.968841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:48.969807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:48.970190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:48.970581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:48.980393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:48.981980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:48.997180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:48.998818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:49.000892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 276/559] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:49.002156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.025596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.027088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.095489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.126131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67699c3c-9fca-4d23-aca6-c3555884b5f0 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.143137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 284/560] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:49.148105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.161858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.162536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.162818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.163092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.163888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:49.164194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.165578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918b12b-e6cd-47b4-8ca9-934439279108 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.174552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 277/561] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:49.179545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971bab1-70c8-4e0b-ac69-2314675847fd None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.179545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971bab1-70c8-4e0b-ac69-2314675847fd None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.179545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971bab1-70c8-4e0b-ac69-2314675847fd None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.179545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 278/562] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:49.179545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971bab1-70c8-4e0b-ac69-2314675847fd None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.211074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.257042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca473be4-e9df-498e-9330-dff91a734ad7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.301195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971bab1-70c8-4e0b-ac69-2314675847fd None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.304326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.305017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.305300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.305570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.306410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:49.306721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.308198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.326282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 285/563] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:49.327221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.344580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.345491 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.345785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.346147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.346749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.358923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.360435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-23661070-c5f7-4f3d-b599-a53d434440fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:49.379762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:49.380664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:49.381540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:49.381540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:49.381540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:49.381540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:49.381540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 279/564] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:49.382508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.382508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.382679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.400013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:49.401209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:49.437903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c9dd9-023e-4bd4-9e03-1e6fa0bfa3d9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.471075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 280/565] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:49.472183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.474616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.475523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.475875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.476220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.486895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.490308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.492412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:49.513312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:49.514221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:49.515101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:49.515101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:49.515101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:49.515101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:49.519052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 286/566] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:49.519920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.590757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9a2c8-5940-4cbe-9a87-fbe893660640 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.593374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.629132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427bc60-86fe-4b01-903e-bb2de9db9cd4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.630167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.631003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.631316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.632311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.642853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.644592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:49.663175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:49.664117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:49.665005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:49.665005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:49.665005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:49.665005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:49.665005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 281/567] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:49.665298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.671843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.672520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.672791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.673054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.673765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:49.674064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.675516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.688512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 287/568] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:49.689335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.733386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.773759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4faae-44fc-4b91-92c0-f4603a262af1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.795249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c49e6-d194-4c59-960a-583dd7b5dbb4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.808607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.809416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.809691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.809959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.820179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:49.823482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:49.827850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:49.828784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 282/569] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:49.829960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.837883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.838661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.839009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.839364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.840093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:49.840400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.841804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.854398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 288/570] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:49.855229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:49.942966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dcb69-0ab7-4df7-98bd-c6f48a82df51 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.960254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37b283-e5b9-4acf-b953-37bc40b814b7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:49.965562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:49.978260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.978926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.979243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.979521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.980243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:49.980608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:49.981993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274aa6b-4524-4200-9ef6-c94f297ba621 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:49.993713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:49.993854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 283/571] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:49.994513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.994799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.994959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee3310-38b0-4838-b129-14abee60b3bb None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:49.995142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.995269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee3310-38b0-4838-b129-14abee60b3bb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:49.995524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee3310-38b0-4838-b129-14abee60b3bb None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:49.998453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 284/572] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:49.998453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee3310-38b0-4838-b129-14abee60b3bb None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.003692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.005144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:50.019003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:50.019934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:50.020800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:50.021209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 289/573] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:50.022069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.071315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.105022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee3310-38b0-4838-b129-14abee60b3bb None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.122041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5db51e-3693-4855-b41b-cd0c4749b91c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.140404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.141080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.141364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.141636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.142379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:50.142683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.144105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.152397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 285/574] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:50.153191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.158602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.159453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.159734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.160006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.168243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.169704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6d54c364-44d0-4705-9c6b-96b40afd7989 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:50.183372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:50.184414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:50.185339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 290/575] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:50.186075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.186345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.186626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.203550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:50.203773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.204735 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:50.261170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b6348-761c-41b2-b050-fadb4b3e8787 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.274356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 291/576] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:50.275107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.295132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.295963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.296240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.296514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.303639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.305096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.315782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:50.319525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:50.320558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 286/577] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:50.321465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.378749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eadb692-5567-40ab-89ee-8fffd85057f7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.411961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.412610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.412884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.413152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.413945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:50.414225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.415698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.421233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca505f-152b-4395-a891-e0e985bf817a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.423618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.428434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 292/578] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:50.429735 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.456423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.457226 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.457503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.457777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.468024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.469518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:50.487024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:50.488018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:50.489078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:50.489078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:50.489078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:50.489078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:50.489078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 287/579] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:50.489530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.527576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.531311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e474e-ccbd-497b-ab7a-7565c1515ce8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.564813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.565484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.565764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.566039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.566865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:50.567195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.568664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.588342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 293/580] 10.222.0.45 () {56 vars in 1137 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:50.589102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.592649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ad6bd-b9d2-493a-93cb-3bd51ac7b1fb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.629801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.630596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.630881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.631182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.641790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:50.649487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:50.650471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:50.651343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:50.655565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 288/581] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:50.656314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.675195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.689408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea1f1e-9617-4169-a79f-0c401e4c38ed None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.721957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.722622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.722904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.723146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.723989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:50.724297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.725740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.737031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 294/582] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:50.737787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.756504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99d63-43b9-4a59-afef-b174a6ba6bb3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.757384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.790310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.790935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.791264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.791525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.792341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=7a55b74ae1f54fbd81f9459c12f0e10f) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:50.793017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.794484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.799895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 289/583] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/role_assignments?user.id=7a55b74ae1f54fbd81f9459c12f0e10f&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:50.800782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.846191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8abe4-e865-4b92-8239-39ffe8b42808 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.884538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.885195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.885472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.885743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.886474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:50.886887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.888579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:50.906298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 295/584] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:50.907263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:50.918868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.942959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3ff8-4829-4f66-afe8-35d28168d895 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:50.983223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:50.984047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:50.984326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:50.984643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:50.994362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:50.996976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:50.999486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:51.018036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:51.018971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:51.019987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:51.019987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:51.019987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:51.019987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:51.020205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea00ef-8b87-43fe-8cb9-df340c614809 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.023917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 290/585] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:51.024667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.057153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.057833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.058232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.058607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.059465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:51.059774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.061223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.075188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 296/586] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:51.077204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.134662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197120f-a232-4e9c-8dd5-576d39e5c271 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.164765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:51.171449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.172352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.172628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.172896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/ff4b9a16037c4657bd7710297746ad4e/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.185054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b22ff4-54c8-4343-bb50-c8b7136fc5a9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.188213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=ff4b9a16037c4657bd7710297746ad4e, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.189672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.215182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 291/587] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:51 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/ff4b9a16037c4657bd7710297746ad4e/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:51.215182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.245733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.246857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.247132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.247433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.260490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.262356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.264635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:51.281361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:51.283546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:03:51.284972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:51.287432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 297/588] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:51.288430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.350056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cd334-b371-45f4-a0fb-8d9b1a41f8cb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.389346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.390558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.390558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.390558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.391222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:51.391530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.393057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.409633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 292/589] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:51.410076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.437110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ce093-0891-4b32-9a0d-46f266940c7f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.466272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:51.472917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.473728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.474011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.474290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.485342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.486843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:51.504955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:51.506344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:51.507475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:51.507475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:51.507475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:51.507475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:51.507475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 298/590] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:51.507475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.551382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8dc5b-2bb8-4792-8558-ec6d1551d89a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.591543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:51.598454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.599548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.599981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.600400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.601850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:51.602318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.604327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.614246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89727695-9b20-44bb-a89d-d82f07b9093b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.628742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 293/591] 10.222.0.45 () {56 vars in 1137 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:51.630540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.654175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.654886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.655195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.655468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.662472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.664092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:51.679075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:51.680027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:51.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:51.685209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 299/592] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:51.686072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.761087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:51.767974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6c88-e1fd-4214-a136-a5c18fe5927a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.787730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afe043-68a9-4c3f-b7a3-5f482c12bb06 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.813396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.814370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.814750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.815463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.815734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:51.816324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:51.816702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.818570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.828319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:51.829125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:51.829497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:51.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:51.833620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 294/593] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:51.834477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.845210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:51.846710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:51.867305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:51.868213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:51.869085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:51.869085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:51.869085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:51.869085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:51.873308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 300/594] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:51.874170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:51.961857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869163f-27f3-46ed-9ba4-459a451939fd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:51.994615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec056282-78ec-4c27-91bd-89e75b742724 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.001475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.002150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.002428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.002702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.003585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:52.003990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.005438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.025177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 295/595] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:52.026214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.034378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.035673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.035961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.036242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.046324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.048164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.049677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:52.068586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:52.069576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:52.070493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 301/596] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:52.071074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.103593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:52.146309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142994-29db-48d0-a159-5bdf09556d7e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.183554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.184588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.185089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.185515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.186393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:52.186842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.187591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65190794-5238-4399-9a8e-4a268a66cdc7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.188639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.206584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 296/597] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:52.207761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.223797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.224639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.225379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.225674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/096d124cc0484429858b2e5f6790ecb9/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.240279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=096d124cc0484429858b2e5f6790ecb9, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.241779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.256301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 302/598] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:52 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/096d124cc0484429858b2e5f6790ecb9/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:52.257240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.321691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:52.337290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:52.351131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3859c-542a-4e61-bfe3-84bbaf291ef0 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.373211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60a27-515e-4fb1-867c-2e908b5ca02d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.393421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.394586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.395080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.395621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.396697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:52.397366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.399127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.413272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.414087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.414370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.414643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.421049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 297/599] 10.222.0.45 () {56 vars in 1139 bytes} [Wed May 25 16:03:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:52.427671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.429155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.436824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:52.451189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:52.452148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 303/600] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:52.453008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.564374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4bc1b-ca05-4feb-8441-b39d2eb6a46b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.604875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:52.612091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.612979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.613402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.613851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.614809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:52.615117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.616606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.644297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 304/601] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:52.650521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.693660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c87e19-4083-476b-99ee-2aea3faf22dc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.774601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.775437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.775714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.775986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.786528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:52.793656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.795173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:52.820882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:52.821800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:52.822853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:52.822853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:52.822853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:52.822853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:52.822853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 298/602] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:52.830166 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:52.841122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e046-f2df-4242-b694-e4108bce3104 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:52.917314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:52.918668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:52.918945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:52.919238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/9eb3714586bf4b50a1a9b29358f92b2f/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:52.946096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=9eb3714586bf4b50a1a9b29358f92b2f, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:52.947867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:52.984938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 305/603] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:52 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/9eb3714586bf4b50a1a9b29358f92b2f/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:03:52.998520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bdf6f-e013-494c-90e4-57bb7bd012bd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:53.037904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:53.038585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.038863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.039136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.039893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:53.040198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:53.041610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f6c84-1a65-41a8-ae07-3fb4c449f422 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:53.055042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 299/604] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:53.060829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:53.144119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:53.173060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093f150-7f69-496b-96a8-ed0c2d8f48a0 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.173335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093f150-7f69-496b-96a8-ed0c2d8f48a0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.173608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093f150-7f69-496b-96a8-ed0c2d8f48a0 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.175143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 300/605] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:03:53.193529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.193870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.194081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.216400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2fe0b-2969-48b0-ab5b-62b0da41c4b7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:53.228870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:53.230093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:53.270740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:53.271837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.272122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.272828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.281369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:53.283096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:53.298356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:53.302054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:53.303279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:53.304647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 306/606] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:53.311797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:53.324192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 301/607] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 16:03:53.352951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:53.485361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b90d3-b56f-400e-adf4-9d5ac0a189b2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:53.498213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:53.538813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:53.539513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.539791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.540061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.540966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:53.541273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:53.543361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:53.554921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e495093-bbbb-49e9-905f-dfb5fe9df129 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:53.555855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 307/608] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:53.570126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:53.604497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98966724-467e-4648-a96a-60b87edbf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:53.605531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966724-467e-4648-a96a-60b87edbf678 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.605814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966724-467e-4648-a96a-60b87edbf678 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.606087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966724-467e-4648-a96a-60b87edbf678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.619290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98966724-467e-4648-a96a-60b87edbf678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-98966724-467e-4648-a96a-60b87edbf678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:53.628824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:53.629945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:53.630976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 302/609] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:53.632017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9da80-aafb-4070-a0dc-8388d3dee14a None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.632017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9da80-aafb-4070-a0dc-8388d3dee14a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.632303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9da80-aafb-4070-a0dc-8388d3dee14a None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.638263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 303/610] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:53.639073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9da80-aafb-4070-a0dc-8388d3dee14a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:53.686373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ca081-a8b7-4217-8ff8-efddf4e43774 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:53.698811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:53.727674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff367a8-12f6-4cc4-93c8-3ed3aa201ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:53.729079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff367a8-12f6-4cc4-93c8-3ed3aa201ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.729562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff367a8-12f6-4cc4-93c8-3ed3aa201ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.730036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff367a8-12f6-4cc4-93c8-3ed3aa201ef4 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/99e8bd308e5549618c66d6edaf02523c/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.746361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff367a8-12f6-4cc4-93c8-3ed3aa201ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=99e8bd308e5549618c66d6edaf02523c, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:53.748225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff367a8-12f6-4cc4-93c8-3ed3aa201ef4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:53.768023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9da80-aafb-4070-a0dc-8388d3dee14a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:53.768717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 308/611] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:53 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/99e8bd308e5549618c66d6edaf02523c/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:03:53.770644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.771181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.775698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.807247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:53.807247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:53.807247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:53.807247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:53.807688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:53.807688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:53.807835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:53.810796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:53.812484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:53.819196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 304/612] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:53.822941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:53.831291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:53.963535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 309/613] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:54.022810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75bf8-34c8-4963-8e98-774b1e7790db None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.022990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.025296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:54.079892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.081067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.081812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.083287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.097458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.101557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:54.126247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:54.127194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:54.128095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:54.128095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:54.128095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:54.128095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:54.130967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 305/614] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:54.136499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.175986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b793a0-6848-446b-bb44-feee60a1d8bb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.236481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.237284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.237559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.237827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.255697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:54.270165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:54.271170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:54.273092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 310/615] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:54.279293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.285780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:54.309930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c50d7d-1faf-43ef-9363-659f7255f205 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.375593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.376386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.376551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.376813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.377527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:54.377826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.379443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:54.405719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 306/616] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:54.411346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.441581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0dc2a-3826-436d-b47c-3455e6a165ad None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.452733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:54.480702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.481523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.481803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.482070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.482814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:54.483116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.484596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:54.494858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 311/617] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:54.500506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.587090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f29a5a-02ad-4523-93b4-ac6cdd32b807 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.632597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.633458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.633784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.634149 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.640974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:54.644229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.647070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:54.663466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:54.664512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:03:54.665428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:54.668628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 307/618] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:54.674272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.683176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ac8f4-9192-4010-8937-7c4396c51eb7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.715777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.716589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.716865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.717137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.728782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.730487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:54.763214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:54.764182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:54.765059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:54.765059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:54.765059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:54.765059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:54.765059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 312/619] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:54.765059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.791871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:54.837901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1186-9bc2-4f9c-a71b-2c76f19a0d35 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.904017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.904728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.905015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.905291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.906148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:54.906465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.908092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:54.922146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8a1d-47a9-4d6f-8515-fffeea3ccbe9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:54.943531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:54.945323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 308/620] 10.222.0.45 () {56 vars in 1135 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:54.953437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:54.973821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:54.974545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:54.974824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:54.975096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:54.975897 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:54.976204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:54.977594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.008696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 313/621] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:55.020971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.161040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b1eb6-6b76-43ef-a4a3-e7b21b385857 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.167498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce91e4-6443-4448-b80d-0ee71b5677a4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.201016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:55.206537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.207756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.208110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.208471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.213945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.214888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.215181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.215476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.221253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.222754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.225533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.227572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-3190e49b-e022-44dc-b06e-378aa2f20b52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:55.245463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:55.246552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:03:55.247534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:55.248069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:55.248839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:55.249721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:55.249721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:55.249721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:55.249721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:55.249934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 314/622] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:03:55.250008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 309/623] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:55.250084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cc7a-edf3-4e0d-b5ba-6f11c5db14e3 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.250084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cc7a-edf3-4e0d-b5ba-6f11c5db14e3 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.250084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1cc7a-edf3-4e0d-b5ba-6f11c5db14e3 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.250259 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 315/624] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:55.255411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.256845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569328-cf93-424c-9456-7f854c912640 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.257199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569328-cf93-424c-9456-7f854c912640 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.257533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14569328-cf93-424c-9456-7f854c912640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.280981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-14569328-cf93-424c-9456-7f854c912640 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:55.282152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-14569328-cf93-424c-9456-7f854c912640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:55.340034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:55.355196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 316/625] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:55.356876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14569328-cf93-424c-9456-7f854c912640 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.367964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5d2fd-866a-4974-ad23-badac44109ea None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.408926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.409620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.410089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.410435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.411444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:55.411921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.413652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.437987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 310/626] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:03:55.438969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.469054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14569328-cf93-424c-9456-7f854c912640 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.485256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:55.506664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.507969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.508396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.508824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.509685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:55.510238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.511944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.524176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 317/627] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:55.525210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.547606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9aff4-d315-4451-af06-cef4609329aa None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.554872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:55.586777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.587624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.587894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.588323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.598914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:55.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:55.607949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 311/628] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:55.608886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.638472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ae65-6c32-42ff-9566-c16738f57e6f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.674909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.675518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.675801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.676302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.717784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ffce8-ccaa-4cbd-aa2c-7c232859d454 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.719471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:55.751281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.753365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.754617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.755666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.755960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.756999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.765700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.767237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.780310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-5f28d931-f6de-47eb-9701-fde4c1cd4aa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:55.781322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:55.782228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:55.783108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 312/629] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:55.784153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146441-4739-4461-a24a-9e05c91a2945 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.784153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146441-4739-4461-a24a-9e05c91a2945 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.784290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b146441-4739-4461-a24a-9e05c91a2945 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.785741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 313/630] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:55.790433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146441-4739-4461-a24a-9e05c91a2945 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.868113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 318/631] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:55.868113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:55.912140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b146441-4739-4461-a24a-9e05c91a2945 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.949135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:55.950132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.950606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.951109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.952102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:55.952597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:55.954043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27734b68-c36b-49d7-a2d4-edc9f8bee6a7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:55.962893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 314/632] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:55.964179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:55.964465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:55.964779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:55.973430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcc204-0324-42ea-9a8c-a1b09f223aa5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:55.982918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:55.984513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:56.001283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.002669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.013246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.014036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.014369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.014703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.015576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:56.015885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.017321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.029074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 319/633] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:56.034378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.059135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 315/634] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:56.072455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.156176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beded284-8210-4630-9f20-0cae0d0e5c22 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.190590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f1d55-6dc3-45e4-afc0-d218a7357d8b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.196218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.197358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.197819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.198299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.211612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.213397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.228385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.229196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.229476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.229746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:56.233492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:56.234357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:56.235263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:56.235263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:56.235263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:56.235263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:56.236772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 320/635] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:56.237697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.244148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.245623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:56.267747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:56.268698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:56.269751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:56.269751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:56.269751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:56.269751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:56.269751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 316/636] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:56.269751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.279937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.287908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.349917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24b44-3e31-4e10-ad56-6bd5bed7ba60 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.382462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13b116-000f-4b39-82c2-551aa696f951 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.384954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.385864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.386139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.386433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/7a55b74ae1f54fbd81f9459c12f0e10f/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.400612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=7a55b74ae1f54fbd81f9459c12f0e10f, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.402093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.418152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.418707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 321/637] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:03:56 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/7a55b74ae1f54fbd81f9459c12f0e10f/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:03:56.419129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.419510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.419935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.420215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.442449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:56.450964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:56.452171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:56.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 317/638] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:56.454552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.525376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.536649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.540347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf64221-d8cb-4d9f-993b-811b841d07b7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.579904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.580586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.580692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb6eea-00a9-417a-a8d2-e97f28d79a1b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.580858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.581135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.581863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:56.582177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.583673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b772c-8cda-419f-9bc9-6b21fedd5236 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.596601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 322/639] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:56.597981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276af51-9993-4323-a880-7eb4a59ea437 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.598268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276af51-9993-4323-a880-7eb4a59ea437 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.598562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276af51-9993-4323-a880-7eb4a59ea437 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.599955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 323/640] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:56.600504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276af51-9993-4323-a880-7eb4a59ea437 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.627185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.627860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.628146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.628424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.629147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:56.629468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.630847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.643283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 318/641] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:56.644130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.710379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276af51-9993-4323-a880-7eb4a59ea437 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.748305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.749234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba225ba-4fc4-4eef-9fac-6dc0f0c59520 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.749404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.749814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.750223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.751118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:56.751599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.753008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041459-6678-45ab-a8d4-73760ae76a87 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.762174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 324/642] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:56.763669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.763994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.764278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.781376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:56.782094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.782475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:56.785585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:56.794526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.795687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.795967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.796240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.803102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.804591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:56.818619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:56.819815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 319/643] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:56.820736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.871182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 325/644] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:56.871182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:56.935781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242aa586-8a01-48e5-b18a-df583e66a29d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.972213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:56.973026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:56.973310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:56.973583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:56.979737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e0224-5bdd-4319-9776-09b9693afe0f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:56.981270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:56.982721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:56.997023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:56.997998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 320/645] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:56.999079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.024421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.025932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.026612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.027111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.038725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.043215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.045480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.054598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:57.065554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:57.066496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:57.067411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:57.067411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:57.067411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:57.067411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:57.071469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 326/646] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:57.072357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.124429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f83e95-db67-4b8a-9699-aa9637dcc675 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.160276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.161100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.161383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.161654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.162821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:57.163372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.164820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.182566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 321/647] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:57.182566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.185199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cbda1-f190-4fed-b32d-d8f7eb4976cb None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.222795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.223637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.223919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.224200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.235116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:57.242909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:57.244008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:57.244899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 327/648] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:57.245598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.288530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683aae5-dd09-48bf-ac77-ab3ee5e6ebd4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.297345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.303747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.326690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.327640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.328180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.328458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.329287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:57.329712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.331169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.354189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 322/649] 10.222.0.45 () {56 vars in 1137 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:57.354189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.354479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baccbf-1d6a-4200-97c0-471088f41b44 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.394780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.395483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.396202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.396467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.397654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:57.398012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.399946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.420929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 328/650] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:57.420929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.459387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac352e-8fdd-48d8-ba55-3b6918661dfd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.497982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.498645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.498918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.499210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.500038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=ff4b9a16037c4657bd7710297746ad4e) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:57.500350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.501924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.515561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 323/651] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/role_assignments?user.id=ff4b9a16037c4657bd7710297746ad4e&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:57.515561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.539828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b374a-07a3-4801-84b3-8642822d51f1 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.549877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.567633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.599446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.600388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.600678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.601882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.602675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:57.602989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.604491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.617205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 329/652] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:57.618120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.643504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281a56-cddc-4e61-aa0a-39faccd3aa87 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.684017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.684747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.685185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.685515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.751818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44abe15-0d35-4c0e-95dc-66f8cac69afa None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:57.786999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.788512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.789817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:57.790858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:57.791964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:57.792249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:57.805889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:57.807511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:57.818427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:57.827615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:57.828600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:57.829620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 330/653] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:57.830206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.881691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:57.919438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 324/654] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:57.920456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:57.957937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120945a-1697-4a4f-99db-30ecfa1800d7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.003501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.004521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.004900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.005284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.018856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.021527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.037449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba03ad-92fd-4b8a-8947-d1c844c0fef7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:58.039866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:58.040723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:58.041596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:58.041596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:58.041596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:58.041596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:58.044975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 331/655] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:58.046688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.069779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.077883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.078842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.079385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.079855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.080847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:58.081317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.083084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.103532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 325/656] 10.222.0.45 () {56 vars in 1137 bytes} [Wed May 25 16:03:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:58.104756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.157061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.177388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e1ea6-5d32-4946-b6cc-4e5b6662d41f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.215033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5c803-d5cd-44be-9e04-b214101ab7fb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.219312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.220577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.221056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.221539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.233789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.235811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:58.255277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:58.256327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:58.257426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:58.257426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:58.257426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:58.257426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:58.259447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 332/657] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:58.259986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.260687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.260800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.261094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.261480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.262260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:58.262635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.264118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.280452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 326/658] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:58.281653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.343966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.374155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64b2bc-7349-468f-964e-cff795eccc3a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.410889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.411999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.412462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.413011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.420219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f287e9b-e9b4-47da-beab-2ea22fe061ee None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.425593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.473004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.473782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.474126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.474465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.475566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:58.477213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.478937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.494247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 327/659] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:58.495512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.501789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.503489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.608370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06371d0-6c8a-4682-890e-6304dacdad7e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.610657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 333/660] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:58.612111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.617281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.645763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.646802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.647286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.647725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.654348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.656028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.657903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:03:58.677242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:58.678831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 16:03:58.680202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:58.683733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 328/661] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:58.684797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.720052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238034b3-ee71-48a6-b1ea-076f3dddfa6b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.758114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.758942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.759265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.759526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.770281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.771811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:58.787070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:58.788274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:03:58.789198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 334/662] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:58.789710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.812093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f9a19-c4e7-4e76-ac35-c365bb29ee89 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.853760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.854563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.854839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.855141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.866042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.867476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-72115c30-1711-4209-9de8-e0feb716667d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:03:58.888108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:58.889058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 329/663] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b65c-3d0f-4101-9d8d-d8775e9c00b3 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b65c-3d0f-4101-9d8d-d8775e9c00b3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243b65c-3d0f-4101-9d8d-d8775e9c00b3 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.895792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 330/664] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:03:58.896291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243b65c-3d0f-4101-9d8d-d8775e9c00b3 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:58.907847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.911882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c17752-ef69-41fa-9ff6-cdefb03e5def None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:58.920527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:58.950668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:58.951482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:58.951867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:58.951995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:58.952904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:58.953128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:58.955363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:58.973136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 335/665] 10.222.0.45 () {56 vars in 1139 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:58.973959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.018104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243b65c-3d0f-4101-9d8d-d8775e9c00b3 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.058926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.059674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.059961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.060251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.061045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:59.061408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.063596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da429dc-00ad-4942-8c99-bce997f28686 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.079783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 331/666] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:59.081352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.081840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.082314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.090398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d73f29-c748-4edf-8b5b-353d73b45e55 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.101375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:03:59.102657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:59.129931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.130835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.131395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.131677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.132537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:59.132845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.134762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.154596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 336/667] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:59.154596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.172265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 332/668] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:03:59.173352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.189810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:59.194713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:59.294954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890e61-f0f8-475f-936d-336b70b64eff None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.298845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d004b-6feb-4056-9d56-9f74be20d319 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.329600 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.330240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.330519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.330789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.331644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=096d124cc0484429858b2e5f6790ecb9) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:59.331957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.333441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.340447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 333/669] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/role_assignments?user.id=096d124cc0484429858b2e5f6790ecb9&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:59.340447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.351356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.352138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.352483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.352953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.437885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:59.473125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.474764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.476473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a4098-d06c-4a45-aae6-bc4da5c3e898 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.498696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:59.516213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.517692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.518209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.518680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.527095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.529017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:03:59.545896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:59.546845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:03:59.547782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:59.554972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 334/670] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:59.556279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.607984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 337/671] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:03:59.609077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.702071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea709f-964d-47b4-9d40-ff79c576ae7e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.738128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a71f28-896f-44db-896b-0578049d3f91 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.744861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.745723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.746109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.746384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.758859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:59.759360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:03:59.767536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:59.779052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.779964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.780392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.780834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.781766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:59.782219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.783833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:03:59.784327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:03:59.785463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:03:59.786426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:03:59.787060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 335/672] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:03:59.788196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.801318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 338/673] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:59.802431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.913678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b8c1-11d0-417e-abb9-680f27fb4062 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.914252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb4b1-6c3c-475d-a612-9756d0477aaf None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:59.948266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.948977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.949254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.949521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.950252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:03:59.950551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.951959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:59.952059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:59.952877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:59.953227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:59.953505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:59.965021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 339/674] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:03:59.965021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:59.973097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:59.975744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-b92757c5-9a9a-4f46-9e74-f8e78dde484c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:00.006551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:00.007576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:00.008448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:00.008448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:00.008448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:00.008448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:00.008674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 336/675] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:00.010676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638355-df1c-42e0-b8f7-7cc93a2deecb None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.011183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638355-df1c-42e0-b8f7-7cc93a2deecb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.011643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26638355-df1c-42e0-b8f7-7cc93a2deecb None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.018238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 337/676] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:00.018238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26638355-df1c-42e0-b8f7-7cc93a2deecb None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.032702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.088950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.114107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303f55b-636f-4980-a605-bb2e395ea746 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.151372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.151619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26638355-df1c-42e0-b8f7-7cc93a2deecb None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.152101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.152384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.152647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.153529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=9eb3714586bf4b50a1a9b29358f92b2f) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:00.153850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.155479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.161848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 340/677] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:03:59 2022] GET /identity/v3/role_assignments?user.id=9eb3714586bf4b50a1a9b29358f92b2f&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:00.162664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.210899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.212649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.213093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.213509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.229624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.231522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e865a216-6c8e-4694-8cad-ec7467fcf1f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:00.250675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:00.251837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:00.252729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:00.252729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:00.252729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:00.252729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:00.259572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 338/678] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:00.261414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.261921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.262372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.280467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:00.281771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e01e9-1604-465d-bd8f-5662f4e47d6b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.282201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:00.283539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.321483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.322111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.322395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.322669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.323444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:00.323752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.325301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.339680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 341/679] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:00.340689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.371569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 339/680] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:00.371569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.402258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.463286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0014a-2b04-49a5-9e31-6e631405acd5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.492156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7abe-9664-40f5-854d-8216beef9dea None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.503291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.504701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.505177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.505916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.507114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:00.507683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.509771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.524474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 342/681] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:00.525647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.536856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.537726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.538009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.538284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.548321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.550096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.567543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:00.569233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:00.570059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:00.571378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 340/682] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:00.571859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.650157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06722b98-7285-48be-b9aa-0b43cabadb75 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.688488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.689626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.690076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.690380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.691105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.705570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:00.710649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0b6ff-c5b1-4ead-b213-283fdf4295f2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:00.714350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:00.715408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:00.716213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:00.719034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 343/683] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:00.720059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.750988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.752229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.752703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.753165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.762162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.764539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:00.779611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:00.780558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:00.781458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:00.784113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 341/684] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:00.785170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.824018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:00.845507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0382a-0676-4be0-afe9-7d4e35092dc3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.882512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.883721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.884222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.884679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.885646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:00.886590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.888253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.901958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 344/685] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:00.903102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.924201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b46dbc-1cd7-46bf-8e9c-b08cbdfd261b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:00.960109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:00.961180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:00.961709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:00.962172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:00.963285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:00.963783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:00.965432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:00.978859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 342/686] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:00.980314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:00.996262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.025586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a793c3-5b25-4b84-8026-cc52a87dd77c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.062256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.063518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.064026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.064489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.065519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:01.066038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.067771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.084424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.094023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 345/687] 10.222.0.45 () {56 vars in 1135 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:01.095446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:01.113686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62409b-8871-4b9b-af7c-32cadf52e4af None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.159534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.160293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.160570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.160841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.161668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=99e8bd308e5549618c66d6edaf02523c) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:01.161977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.163642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.175229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 343/688] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:00 2022] GET /identity/v3/role_assignments?user.id=99e8bd308e5549618c66d6edaf02523c&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:01.175229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:01.249408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567125a-2098-4c44-84dc-096c9e085701 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.318062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.319860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.320436 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.323383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.336694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.347021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.348779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:01.374349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:01.375548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:01.376628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:01.376628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:01.376628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:01.376628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:01.383355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 346/689] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:01.385016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:01.415299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2461-f38e-472c-b61c-a728e409fe3a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.458657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.466340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.467929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.468390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.469064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.514793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf374c-91da-435e-a17f-4345f04514f6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.559701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.560387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.560733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.561082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.561946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:01.562341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.564693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.565192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.567299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.581944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 347/690] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:01.587302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:01.651988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.688612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 344/691] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:04:01.694279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:01.821031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583e8a3-1f6d-46c8-8777-afbb8e1ef6af None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.828568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7ccc1-a6b2-4393-8bf9-d921a56d0a0e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:01.856500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.857591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.857845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.857953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.858125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.865881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:01.867013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.867775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.868248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.869936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.871923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.877015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:01.878810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-5c7d86c6-0d06-456b-b0a4-74acc4dc33f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:01.889863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:01.890764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:01.892046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:01.892046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:01.892046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:01.892046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:01.892046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 345/692] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:01.892739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12643e-09ca-45f7-b0ce-9546138de583 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.893021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12643e-09ca-45f7-b0ce-9546138de583 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.893294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12643e-09ca-45f7-b0ce-9546138de583 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.894680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 346/693] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:01.902034 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12643e-09ca-45f7-b0ce-9546138de583 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-04011148-343c-450c-9f6d-0ff23b2847e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:01.903046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:01.903981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:01.904930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:01.908980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 348/694] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:04:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:01.910449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:01.910730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:01.910996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:01.925983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:01.929772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:01.930957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:02.008888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12643e-09ca-45f7-b0ce-9546138de583 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.025935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 349/695] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:02.027390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.068221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.068953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.069237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.069510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.070238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:02.070549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.072056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.090397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 347/696] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:02.092272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.145253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f93c4-8eef-4bff-91c9-8f50bb1fceed None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.175601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.182777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.183696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.184071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.184426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.186304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:02.186722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.188314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.206289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.209457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 350/697] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:02.211249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.227438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff028f-7e49-4d2d-b273-20fc91dc8a44 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.273141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.273884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.274162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.274433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.287311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.288774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:02.307597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:02.308678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:02.309566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:02.309566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:02.309566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:02.309566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:02.313823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 348/698] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:02.314792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.326242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cc54-a575-4b55-9417-34dde8d2fdd4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.363861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.365052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.365581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.366055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.373733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.375496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:02.393700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:02.394650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:02.395586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:02.398070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 351/699] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:02.399267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.424307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.429733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faaad4-a008-4574-92eb-a57a56a7a351 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.469229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.469884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.470275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.470481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.474416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.513641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669815ef-146f-40d5-99e2-1c8f037b900c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.544378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.545985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.550651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.551771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.552481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.553151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.554694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:02.555384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.557088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.569950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 352/700] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:02.571199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.665847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 349/701] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:04:02.666495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.667105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.692086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478b95f-f194-45e4-b23b-61a7a1a8593e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.704775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.730320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.730998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.731305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.731581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.732365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:02.732681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.734123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60f71d-4de9-4544-9485-1f7dedeb84d7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.746591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 353/702] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:02.748014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d694-2c38-4f77-942b-71faf629ba67 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.748300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d694-2c38-4f77-942b-71faf629ba67 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.748575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d694-2c38-4f77-942b-71faf629ba67 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.754037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 354/703] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:02.754903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d694-2c38-4f77-942b-71faf629ba67 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.780490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a09f-2f19-4880-a474-2ca839be3e1f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.817350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.818131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.818410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.818686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.819427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.820873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.841135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 350/704] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:04:02 2022] POST /identity/v3/users => generated 254 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:02.841135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:02.873449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d694-2c38-4f77-942b-71faf629ba67 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:02.916574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:02.916962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.917190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.917864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.928550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:02.930948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:02.932828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-7a4e4b3a-f39a-4b79-b4ee-bc50f15434a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:02.953920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:02.955025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:02.955965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:02.955965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:02.955965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:02.955965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:02.962909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 355/705] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:02.965205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:02.965679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:02.966125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:02.987535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:02.989064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:02.991453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:03.005661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6e728-fbe1-4d2f-ac18-4fcba28426c5 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.054707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.055828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.056216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.056588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.057530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=7a55b74ae1f54fbd81f9459c12f0e10f) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:03.057937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.060843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.073094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 351/706] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:02 2022] GET /identity/v3/role_assignments?user.id=7a55b74ae1f54fbd81f9459c12f0e10f&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:03.074760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.091665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 356/707] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:03.113751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.215936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9c4c5-0723-46b8-8019-8b101e82c17c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.242784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50461487-cd08-41f8-ab32-d7e8a41e38d5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.261241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.262869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.263333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.263749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.264644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:03.265098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.267290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.269282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:03.283713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.284550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.284838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.285163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.285831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.287374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.288109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 352/708] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:03.296284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:03.320036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:03.321322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:03.322225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 357/709] 10.222.0.45 () {56 vars in 1129 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:03.328403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.341087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:03.432256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5bbd6-bb77-4bf0-99b4-741cb8ded766 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.450002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1649a5-6e7a-499b-a480-f900839d188d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.476889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.477661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.477905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.478363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.486303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.487938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.488079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.488901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.489987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.490416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.491301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:03.491821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.493422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.498900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 358/710] 10.222.0.45 () {56 vars in 1124 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:03.503182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:03.504076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:03.504962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:03.508920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 353/711] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:03.510084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.510321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.563521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:03.607994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:03.621624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1c3e4-7840-4c7f-936b-d823029a6cb6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.629341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ac143-d2b6-4a6b-b2bd-b3945b626fc4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.658457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.659759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.660481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.661267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.662453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:03.662961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.664578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.666325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.666997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.667319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.667974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.668773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:03.669085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.671483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601b27d-3a17-4db8-a96b-604bbff399b4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.673464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 359/712] 10.222.0.45 () {56 vars in 1124 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:03.690418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 354/713] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:03.693485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:03.815483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263d05-d2cc-4b61-951e-edde6aca3376 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.815861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263d05-d2cc-4b61-951e-edde6aca3376 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.816026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a263d05-d2cc-4b61-951e-edde6aca3376 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.817682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 355/714] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:03.818719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264577f2-2550-4d01-bfd8-b4ad16f6c326 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:03.823347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.823647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.823954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.845504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:03.856438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:03.857330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:03.857671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:03.858360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:03.858788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:03.859374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:03.860772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=ff4b9a16037c4657bd7710297746ad4e) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:03.861256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:03.862910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:03.870713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 360/715] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/role_assignments?user.id=ff4b9a16037c4657bd7710297746ad4e&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:03.956328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 356/716] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:03.981014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:04.110046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc991304-59a4-4022-a1e9-4a853fd30d9e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:04.144808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:04.145619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:04.145896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:04.146168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] PATH_INFO: `/v3/services/network` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:04.146828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:04.148319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:04.160409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:04.161460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:04.162317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 361/717] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:03 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:04.170011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:04.236559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:04.273936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c117a-2b52-469d-a8a6-126ca0987e0c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:04.309253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:04.309931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:04.310211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:04.310485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:04.311219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] RBAC: Adding query filter params (name=network) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:04.311530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:04.312923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d791f7-d530-4f67-88ef-38e79326c68b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:04.318121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 357/718] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:04.323769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:04.387904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:04.459835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada5db6-5bb9-4c82-a01a-d9bd472d7032 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:04.506690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:04.507402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:04.507679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:04.507949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:04.508656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:04.508960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:04.510394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac2e3c-0961-463b-abdc-bb8ba77f27b2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:04.515786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 362/719] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:05.620652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94574d79-681e-4200-bfc8-40c00e3b300c None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:05.621177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94574d79-681e-4200-bfc8-40c00e3b300c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:05.621177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94574d79-681e-4200-bfc8-40c00e3b300c None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:05.622878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 358/720] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:05.628321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:05.628752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:05.628926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:05.652220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:05.653428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:05.733608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 363/721] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:05.768142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94574d79-681e-4200-bfc8-40c00e3b300c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:05.894569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94574d79-681e-4200-bfc8-40c00e3b300c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:05.923555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:05.929747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:05.930560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:05.930846 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:05.931207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:05.942074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:05.950038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:05.950999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:05.951870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 359/722] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:04:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:05.957055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:06.010777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:06.087527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885df337-eedd-44e4-8db1-c9d503cabd12 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:06.127869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:06.128551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.128833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.129109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.129859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:06.130164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:06.131567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f98b9a-d7b5-4dd3-aa3a-90bf1f958e74 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:06.140301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 364/723] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:04:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:06.145706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:06.450386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be60e9-f7fc-4528-822a-4a4b1ad87a5f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:06.484371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52952495-6fd8-4567-a399-3c442486795c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:06.485176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52952495-6fd8-4567-a399-3c442486795c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.485455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52952495-6fd8-4567-a399-3c442486795c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.485726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52952495-6fd8-4567-a399-3c442486795c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.496403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52952495-6fd8-4567-a399-3c442486795c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:06.497865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52952495-6fd8-4567-a399-3c442486795c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:06.511933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602d5b1-48f5-40d3-bbf2-8d19a88e361e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.512213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602d5b1-48f5-40d3-bbf2-8d19a88e361e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.512481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602d5b1-48f5-40d3-bbf2-8d19a88e361e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.514118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 365/724] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-52952495-6fd8-4567-a399-3c442486795c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:06.515661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:06.517534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:06.518657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:06.518657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:06.518657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:06.518657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:06.518657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 360/725] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:06.525407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602d5b1-48f5-40d3-bbf2-8d19a88e361e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:06.525551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265855d-0518-48c1-a1d9-b1fecef2206b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.525551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265855d-0518-48c1-a1d9-b1fecef2206b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.525551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265855d-0518-48c1-a1d9-b1fecef2206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.552639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b265855d-0518-48c1-a1d9-b1fecef2206b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:06.554053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b265855d-0518-48c1-a1d9-b1fecef2206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:06.607384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:06.638431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:06.641856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 361/726] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:06.643712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8ab6-496f-4c22-a975-c5eac9e05df1 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.644147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8ab6-496f-4c22-a975-c5eac9e05df1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.644606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8ab6-496f-4c22-a975-c5eac9e05df1 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.644711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602d5b1-48f5-40d3-bbf2-8d19a88e361e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:06.646426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 362/727] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:06.647758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9284-0d9d-4b05-a3cc-8b2252bd70b1 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.648237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9284-0d9d-4b05-a3cc-8b2252bd70b1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.648682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b9284-0d9d-4b05-a3cc-8b2252bd70b1 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.650296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 363/728] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:06.660626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd9cbc-3903-478f-a925-be076930761e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.661215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd9cbc-3903-478f-a925-be076930761e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.661673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd9cbc-3903-478f-a925-be076930761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.679664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-abcd9cbc-3903-478f-a925-be076930761e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:06.681209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-abcd9cbc-3903-478f-a925-be076930761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:06.684849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:06.685520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.685802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.686076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.686795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:06.687102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:06.688499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12318746-5966-41c5-920f-7d754ca4828f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:06.700516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 366/729] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:06.701611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.701899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.702172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.719198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:06.720372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:06.762931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 364/730] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:06.762931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd9cbc-3903-478f-a925-be076930761e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:06.791851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 367/731] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:06.793118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:06.887385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:06.896707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd9cbc-3903-478f-a925-be076930761e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:06.898303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:06.902742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9290617-15cb-491b-8fbf-1334ec9c16fb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:06.935193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:06.935856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.936132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.936400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.937111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:06.938029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:06.938466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:06.938848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:06.939130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:06.939433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:06.947612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:06.949381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:06.963022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 365/732] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:06 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:06.963022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:06.974747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:06.975988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:06.976999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:06.977527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 368/733] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:04:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:06.978553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.110590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638e17a-6b9a-49e5-80e1-f4e06e5db200 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.131875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080c0b5-23d3-4b9d-95b2-0a2f7a389e5f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.153990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.154818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.155088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.155391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.170401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:07.178891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:07.179880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:07.180705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 369/734] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:07.181862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.186400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.187551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.188047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.188511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.193736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.204136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:07.213841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:07.214891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:07.215764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:07.216384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 366/735] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:07.216941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.248680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.311092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c503dcc-9f87-4af9-b550-7f06ef41ad96 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.334944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61564713-8fc7-448b-90c9-fc7604a3e107 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.345846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.346512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.346880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.347077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.347906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:07.348211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.349857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.373032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 370/736] 10.222.0.45 () {56 vars in 1149 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:07.373032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.374913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.375631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.375933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.376184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.376942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:07.377249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.378642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4f75e-37e4-4e44-bf6e-67940bd4ba9b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.391910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 367/737] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:07.391910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652679f4-aea1-489c-b939-cf80c34a34d1 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.391910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652679f4-aea1-489c-b939-cf80c34a34d1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.391910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652679f4-aea1-489c-b939-cf80c34a34d1 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.391910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 368/738] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:07.391910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652679f4-aea1-489c-b939-cf80c34a34d1 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.453840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.479974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.490657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872a8ca-83d0-4411-bc5a-ba50c5d21674 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.504334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652679f4-aea1-489c-b939-cf80c34a34d1 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.525385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.526147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.526426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.526721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.527538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:07.527846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.529449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.540203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 371/739] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:07.541166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.545547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.546242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.546530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.546797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.618755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.620270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.650340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216bca9-4f14-4e75-b081-3447b3a12c7a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.678317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.687725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.688555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.688817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.689081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.701432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.702894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.706220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6f32e2d0-b7b7-481b-a949-afc16f3222ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:07.720534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:07.721593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:07.722762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:07.722762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:07.722762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:07.722762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:07.726309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 372/740] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:07.727550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.727835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.728134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.732300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 369/741] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 16:04:07.733465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.749431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:07.750621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:07.821801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 373/742] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 16:04:07.822680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.854109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0ddb-e3f5-4b06-9a46-13fcc6419eb3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.892783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.893815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.894595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.895015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.905864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.907676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:07.927081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:07.928189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:07.929302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:07.929302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:07.929302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:07.929302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:07.929568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889684e1-3237-48e2-ac34-61a0a0420f7c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:07.931349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 370/743] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:07.932432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:07.946141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.966292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:07.972831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:07.973502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:07.973781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:07.974050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:07.974765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:07.975070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:07.976888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:07.988953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 374/744] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:07.989968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.048423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1714f73-2a0f-481c-9db9-1edfdb0a583b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.089036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.089953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.090232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.090503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.097418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137e9fa-93a8-47ea-9ab6-2e5c92a32bc0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.104367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.106278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:08.129872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:08.130883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:08.132211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:08.132211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:08.132211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:08.132211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:08.132211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 371/745] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:08.132211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.137876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.138569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.138852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.139131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.139893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.141280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.168426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 375/746] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:07 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:08.168426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.196874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:08.266152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:08.290586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61422d82-3927-4cbb-82c8-e9723841ae85 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.291209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a01cb8-9024-48c6-83d2-a4016c597507 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.330546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.331438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.331914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.332289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.333223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:08.333627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.335325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.341607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.342426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.342707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.343036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.350645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 372/747] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:08.351265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.352860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.354616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:08.373457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:08.374477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:08.375446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 376/748] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:08.376033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.483795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:08.484687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52889b57-e7f8-4a0e-81a7-e7cc3faee02f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.504641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a5b89-3c84-4f73-a05b-19685db120c8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.525167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.525987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.526342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.526739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.527616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:08.528106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.529672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.545885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 373/749] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:08.548096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.551514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.553359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:08.553474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.554444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.554916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.566289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.569269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:08.589347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:08.590341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:08.591320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 377/750] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:08.591928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.665868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf544757-b24a-433b-8e6b-483811482abd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.703516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.704611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.705111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.705673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.706961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:08.707922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.709673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.724169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5c8f-cbbc-45e0-bd12-be8e05b3f54e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.730598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 374/751] 10.222.0.45 () {56 vars in 1135 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:08.731815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.774424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.775356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.775590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.775880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.785712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.787481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.801810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:08.808101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:08.809010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:08.809894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 378/752] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:08.815310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.821371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:08.856574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e8862-54a6-4c05-bc58-38965580767e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.901078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.901827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.902106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:08.903667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:08.903991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:08.905446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:08.929140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 375/753] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:08.929823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d4c24-3fc4-424c-ae1e-2e5b66ffabf7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:08.930109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:08.966265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:08.967404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:08.967904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:08.968369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.053330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.054803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.055468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338dfdc-f835-4c0b-92af-b7b26064d4bb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.070125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.082783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.102018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.102692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.102974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.103328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.104541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:09.104934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.106637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.126440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 376/754] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:09.126440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.195252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 379/755] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:09.196488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.247624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e375d1-7b9d-4e9c-8dd7-075b474b4b71 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.284523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.285326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.285604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.285869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.296879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.298583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.301412 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153a51ad-402d-491d-bcf8-60f23ffb85d2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.309373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:09.315593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:09.316561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:09.317528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:09.317528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:09.317528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:09.317528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:09.317528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 377/756] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:09.317807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.343766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.344427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.344703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.344975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.345806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=e28dd040159544d7a4ce050fa593dcc1) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:09.346117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.347605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d874931-5ff2-4d48-b629-825d6a51ee71 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.352006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.362929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 380/757] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/role_assignments?user.id=e28dd040159544d7a4ce050fa593dcc1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:09.362929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cbc81-932f-4806-a329-25e8be493ba8 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.362929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cbc81-932f-4806-a329-25e8be493ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.362929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cbc81-932f-4806-a329-25e8be493ba8 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.362929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 381/758] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:09.362929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cbc81-932f-4806-a329-25e8be493ba8 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.464761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c740e-73c3-444a-81e3-b1275c34c3c9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.488148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cbc81-932f-4806-a329-25e8be493ba8 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.512711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.513647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.513997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.514990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.530706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.531121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.531639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.531984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.532324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.532881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.533231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:09.533602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.535070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7e69e-7ccd-4e4d-875d-88d158e7abbd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:09.554463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:09.555623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:09.556725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:09.556725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:09.556725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:09.556725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:09.556994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 382/759] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:09.558857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 378/760] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:09.559550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.562196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.562549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.562845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.583076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:09.584323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:09.608877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.667189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 383/761] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:09.667189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.683529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.704221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71734f-3526-49ae-81f3-79c8b4705b75 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.748377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.749193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.749474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.749743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.759189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.760676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:09.779761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:09.780705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:09.781888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:09.783232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 379/762] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:09.784229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.803564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e62e5-4738-4d19-8679-32016ff8950a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.849311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.849906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.850237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.850516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.851410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:09.851721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.853677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.873527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 384/763] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:09.873527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.898158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.905109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b630ba6-7a67-45b5-892b-8a9764ac8fcf None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:09.942797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:09.944005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:09.944468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:09.944918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:09.945747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:09.947364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:09.961863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:09.962863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:09.963756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:09.971672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 380/764] 10.222.0.45 () {56 vars in 1129 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:09.972901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:09.986007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:09.996211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f52ce-7777-48c1-a28b-ff96b5b3f84b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.035997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.036982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.037501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.037991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.038996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:10.039567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.041218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.059794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 385/765] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:10.061091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.101451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08731b78-a6e1-4a43-8564-8f1443e1051d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.137255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.138210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.138542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.138820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.146450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.147967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:10.163751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:10.164697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:10.165611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:10.171478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:10.172855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 381/766] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:10.173871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.195195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c26365-fb95-4536-b2cc-c4a0e84737de None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.244484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.245662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.246058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.246429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.247531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:10.248349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.250114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.253793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:10.262569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 386/767] 10.222.0.45 () {56 vars in 1124 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:10.262569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.297469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84eccb-aab7-4c38-9e8e-688e7b0e71f4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.338309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.340295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.340729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.341146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/ff4b9a16037c4657bd7710297746ad4e/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.344242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=ff4b9a16037c4657bd7710297746ad4e, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.346127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.372005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 382/768] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:04:10 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/ff4b9a16037c4657bd7710297746ad4e/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:04:10.373907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.398701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f856cc7-741d-43f6-bc9f-ac1a4819da32 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.443706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730df98d-f797-4362-98df-c2525859d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.444432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df98d-f797-4362-98df-c2525859d48c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.444710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df98d-f797-4362-98df-c2525859d48c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.444980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730df98d-f797-4362-98df-c2525859d48c None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.445777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df98d-f797-4362-98df-c2525859d48c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:10.446082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df98d-f797-4362-98df-c2525859d48c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.447595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730df98d-f797-4362-98df-c2525859d48c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.460595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 387/769] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:10.461971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6bfd7-b2e3-4b9f-aa13-28e8408b9ca2 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.462253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6bfd7-b2e3-4b9f-aa13-28e8408b9ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.462525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6bfd7-b2e3-4b9f-aa13-28e8408b9ca2 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.469167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 388/770] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:10.470180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6bfd7-b2e3-4b9f-aa13-28e8408b9ca2 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.482013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:10.539588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dc07-f9e3-4543-8200-22d749dc3389 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.590155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:10.596328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.597736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.598040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.598811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.600433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:10.600552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.602336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf59e5-881c-43ec-b387-2bb7546f536b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.611786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6bfd7-b2e3-4b9f-aa13-28e8408b9ca2 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.611983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 383/771] 10.222.0.45 () {56 vars in 1124 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:10.615824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.616189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.616535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.640124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:10.641654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:10.654286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.655255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.655703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.656183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.657159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=7a55b74ae1f54fbd81f9459c12f0e10f) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:10.657613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.659409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.666146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 389/772] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/role_assignments?user.id=7a55b74ae1f54fbd81f9459c12f0e10f&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:10.667797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.733020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 384/773] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:10.761330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:10.771194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.804790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257188d1-4402-4dc1-9922-201870f2cf10 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.842807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.843949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.844424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.844884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.845869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] RBAC: Adding query filter params (interface=public, service_id=3161ab32fa874334902eae25a0534cb5, region_id=RegionOne) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:10.846455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.848210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:10.857246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 390/774] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/endpoints?service_id=3161ab32fa874334902eae25a0534cb5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:10.863420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:10.914774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb04e4c7-8c3c-4f79-b7cb-4a9ba0c2a277 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.954392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:10.984911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:10.985403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a5d86-b105-4dbb-a95f-12bf76839992 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:10.985734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:10.986020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:10.986291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] PATH_INFO: `/v3/services/network` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:10.986956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:10.991199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:11.010199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:11.011327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:11.012151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:11.013383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 385/775] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:11.020216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:11.044938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:11.051673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:11.052811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.053282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.053742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.054620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:11.056313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:11.063059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 391/776] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:10 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:11.208940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e9b92-c1a8-4b18-b175-6d2f5b532340 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:11.265459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:11.266192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.266473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.266743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.267492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] RBAC: Adding query filter params (name=network) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:11.267799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:11.269243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:11.275552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 386/777] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:11.281604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:11.406811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63de85-d690-476d-83ae-a249c4e0eb6c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:11.441255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:11.442273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.442773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.443277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.444171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:11.444681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:11.446249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:11.451917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 392/778] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:11.457858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:11.512338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:11.570723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21271fb8-b795-43a4-863e-ce92ae4d0611 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:11.608945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:11.609970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.610547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.611028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.612035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] RBAC: Adding query filter params (interface=public, service_id=e389342df8094cafbd3efda4a089d188, region_id=RegionOne) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:11.612533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:11.614110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd53c0-5cf0-40ad-b1fb-3cd3180d3a69 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:11.622785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 387/779] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:11 2022] GET /identity/v3/endpoints?service_id=e389342df8094cafbd3efda4a089d188&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:11.628046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:11.689019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:11.730849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1685bd-43a0-4028-8d77-4c3b49d6cbc2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:11.746988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071381-d4ad-47bb-9cc0-5d1e9a2ff230 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.747305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071381-d4ad-47bb-9cc0-5d1e9a2ff230 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.747629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95071381-d4ad-47bb-9cc0-5d1e9a2ff230 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.749144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 388/780] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:11.754328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.754618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.754894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.771017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:11.771758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:11.772035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:11.772303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:11.773147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:11.774555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:11.781000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 393/781] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:11 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:11.804479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:11.805717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:11.941053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 389/782] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:11.975303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:12.104587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973efd4-e444-4edc-be55-d288c04757b9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:12.128482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:12.146526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:12.147359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:12.147642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:12.147916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:12.164410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:12.172526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:12.173443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:12.174670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 394/783] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:04:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:12.184339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:12.265300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:12.333929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cdf339-f2c0-4018-a648-7314a62f8e3e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:12.436643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:12.437332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:12.437613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:12.437876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:12.438657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:12.438956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:12.440377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:12.449697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 390/784] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:12.455334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:12.610015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312b1e0-96e7-43ee-a1c7-e0f776d9c17a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:12.680778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:12.681996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:12.682480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:12.683017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:12.703677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:12.705558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:12.731452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:12.733348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:12.734487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:12.734487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:12.734487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:12.734487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:12.734487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 395/785] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:12.740297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:12.896885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2faa-8e5e-4f53-b00a-db8227dbe11c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:12.904834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:12.950306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:12.950986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:12.951287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:12.951558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:12.952275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:12.952581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:12.953959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368d530-3c10-45ee-b3ca-c5ee3799d671 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:12.966955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 391/786] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:12.972367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:12.986139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95069f63-70f3-41e8-b7ef-90f411730e64 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:12.986455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95069f63-70f3-41e8-b7ef-90f411730e64 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:12.986709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95069f63-70f3-41e8-b7ef-90f411730e64 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:12.988330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 392/787] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:12.994546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:12.994832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:12.995107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.020775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:13.021964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:13.047526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:13.133118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 393/788] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:13.156504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.193285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f13d7b-76d0-427f-b42e-1af0aa798817 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:13.256810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a11e93-805e-4a91-9fa0-21c8a9a1d05e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:13.271587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:13.296087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:13.296730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:13.297556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.297830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.298100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.299484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.299832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.300102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.318418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:13.320044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:13.321221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:13.329214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:13.330234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:13.331061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:13.335392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 394/789] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:13.338729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:13.355684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:13.356794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:13.357736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:13.370226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 396/790] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:04:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:13.380345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.463836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d80ab-b171-45d0-a4cb-88ade3c93c0d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:13.499673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:13.500490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.500766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.501030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.501768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:13.502076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:13.503525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:13.513674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 395/791] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:13.519280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.539613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:13.563528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:13.575074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e432b34-4ee5-4e0d-b2c2-c2eda634c6be None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:13.636573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:13.637262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.637545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.637820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.638657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:13.638969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:13.640446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b980a9-d475-4497-939d-7b7a1069d3e9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:13.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 397/792] 10.222.0.45 () {56 vars in 1149 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:13.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93daa-95f4-409c-b830-589a21928c1d None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93daa-95f4-409c-b830-589a21928c1d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93daa-95f4-409c-b830-589a21928c1d None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 398/793] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:13.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93daa-95f4-409c-b830-589a21928c1d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.685286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7d02f-d78c-487d-80f2-a174a9703df2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:13.733768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:13.735046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.735452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.735824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.748276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:13.749868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-243516f5-c33d-4e5f-9d0e-0b65fbc1e6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:13.769340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:13.770425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:13.771319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:13.771319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:13.771319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:13.771319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:13.775868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 396/794] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:13.777808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.778274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.778617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.795392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93daa-95f4-409c-b830-589a21928c1d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:13.799323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:13.800084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:13.833110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:13.834243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:13.834716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:13.835144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:13.846927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:13.848765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:13.867292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:13.868261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:13.869124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:13.869124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:13.869124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:13.869124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:13.874162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:13.875750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 399/795] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:13.876697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.881319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 397/796] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:13.882510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:13.893448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:13.997536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9be9d-7cfa-4040-a1d9-96588a3fab5f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.004713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0767b-9d0f-40b6-95f6-328d8403a9f2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.036025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.036697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.036973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.037244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.037957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:14.038258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.039716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.040182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.041065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.041501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.041919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.043187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:14.043664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.045260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b56887-e878-4559-aa40-e66b86a06539 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.052504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 398/797] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:14.053335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.067564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 400/798] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:14.069787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e938-d5d0-4d9c-a8eb-f2a6b6ad4263 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.070109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e938-d5d0-4d9c-a8eb-f2a6b6ad4263 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.070376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e938-d5d0-4d9c-a8eb-f2a6b6ad4263 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.075352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 401/799] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:14.075352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824e938-d5d0-4d9c-a8eb-f2a6b6ad4263 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.126220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.142557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.170050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8d4b-4acd-4c13-8d45-03a45d0877f4 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.180558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824e938-d5d0-4d9c-a8eb-f2a6b6ad4263 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.206391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.207217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.207504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.207770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.217850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:14.218939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.219978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.220464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.220925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:14.225530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:14.226466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:14.227523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:14.229884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.231407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 399/800] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:14.231661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.232805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-5ee59d69-b0ef-4ade-a45c-d13e92323ac1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:14.250157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:14.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:14.252058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 402/801] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:14.253704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.253704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.253704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.271716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:14.272920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:14.351179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 403/802] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:14.351179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.354940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c00d6b-f73d-4a12-be98-68d0153d13ee None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.375837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.390399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.391238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.391519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.391786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.400253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.402334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.409726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:14.421544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:14.422473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:14.423806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 400/803] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:14.424406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.458734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce229224-8c91-422c-a1d1-6844a70e16c0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.491808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.492483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.492765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.493039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.493780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:14.494091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.495546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.504152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 404/804] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:14.504784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.530155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f8ee3-a079-43fe-9299-4b0da00b3d7a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.563106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.563796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.564073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.564347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.565125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:14.565460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.566881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.578417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 401/805] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:14.579215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.608830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba382-6026-4b55-a611-840ae0119f32 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.618944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.625928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.642765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.643623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.643907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.644182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.644863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.646240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-9837dc7e-5a77-423f-99af-2c642d39e9ec None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:14.658087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:14.659134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 16:04:14.660107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:14.663281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 405/806] 10.222.0.45 () {56 vars in 1129 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:14.664695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b729c9-8aed-409d-b98c-618b7c87cfdc None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.664978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b729c9-8aed-409d-b98c-618b7c87cfdc None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.665252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b729c9-8aed-409d-b98c-618b7c87cfdc None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.666524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 406/807] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:14.667308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b729c9-8aed-409d-b98c-618b7c87cfdc None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.677926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb08bb-11b6-43eb-bbf9-3c2aba792259 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.711432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.712097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.712374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.712644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.713476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:14.713788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.715277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.732061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 402/808] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:14.732828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.767848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b729c9-8aed-409d-b98c-618b7c87cfdc None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.802297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.803110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.803439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.803712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.814215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.815811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.827536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.831128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6c4e8-a22b-4e4c-83a6-bc55a4b1c9f9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:14.832818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:14.833688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:14.834675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:14.834675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:14.834675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:14.834675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:14.834675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 407/809] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:14.834961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:14.869692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:14.873029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c415f-8a90-4984-bb80-32966bfefea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.874584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c415f-8a90-4984-bb80-32966bfefea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.875103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c415f-8a90-4984-bb80-32966bfefea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.875645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c415f-8a90-4984-bb80-32966bfefea6 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/e28dd040159544d7a4ce050fa593dcc1/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.893845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c415f-8a90-4984-bb80-32966bfefea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=e28dd040159544d7a4ce050fa593dcc1, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.895329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0c415f-8a90-4984-bb80-32966bfefea6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.908939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 403/810] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:04:14 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/e28dd040159544d7a4ce050fa593dcc1/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:04:14.910179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.910461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.910737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.929836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:14.931070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:14.945377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440cca-b96e-4d1c-b6a9-7996e043fd5e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:14.981493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:14.982202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:14.982467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:14.982766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:14.983511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:14.983815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:14.985230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:14.990447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 408/811] 10.222.0.45 () {56 vars in 1124 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:14.991132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.015229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 404/812] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:15.016131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.124061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.124467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.129102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75afa8b-cc87-4e82-b296-447587731d56 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.151528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf81bb-4dd2-44fe-a846-094c3fdd7b5d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.166588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.167332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.167972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.168246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.187058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.187772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.188052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.188325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.189042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:15.189349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.190732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.202518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 405/813] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:15.203401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.248001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.249567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.308729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f677-21fa-4950-b0d1-1b48ca8e8e7d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.343097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.343719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.344029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.344274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.344976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:15.345279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.346700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.349025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.356203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 406/814] 10.222.0.45 () {56 vars in 1124 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:15.356203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.356463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 409/815] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:15.356463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.360896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.461875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd427c0-50b2-469e-8f78-717a17ca49f4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.463273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afc344-310f-4102-8644-760d044f3f80 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.499517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.500329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.500606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.500873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] PATH_INFO: `/v3/services/network` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.501455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.501630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.502482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.502856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.503019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.503996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.514148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:15.515302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:15.517005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 16:04:15.518466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:15.519260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.519333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 407/816] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:15.519333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:15.535681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:15.536837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 410/817] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:15.537990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.596451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.603795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.634709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e54ff0-abb0-4605-a8dc-8dee0a02e2aa None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.648666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f660d985-55a4-4c67-a4d3-072e516b73fd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.670439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.671500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.671790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.672095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.672849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.674240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.691047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.691938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.692219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.692505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.707200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 408/818] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:15.707200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.713213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.714959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:15.736060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:15.737206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:15.738382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:15.738382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:15.738382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:15.738382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:15.739140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 411/819] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:15.743267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.858884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a118520-104f-4e52-aba4-5ddb4caf5b26 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.872033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb51f1f0-8f26-4d1b-a08c-f00ae959c1d3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:15.873238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.898975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:15.899942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.900728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.901103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.901582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.902793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:15.903231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.904863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.923795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:15.925018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:15.925447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:15.925851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:15.926754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] RBAC: Adding query filter params (name=network) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:15.927281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:15.929906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:15.930093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 412/820] 10.222.0.45 () {56 vars in 1135 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:15.931105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:15.941060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 409/821] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:15.942202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.058311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b5703-8430-47eb-8967-4062fbeb8709 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.069570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa1c2-71d8-4693-9e8b-258ae96dccbd None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.097597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.098281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.098561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.098833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.099599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:16.099890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.101291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.111049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.112087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.112508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.112920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.118649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 413/822] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:16.119657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.125434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.127071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:16.145262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:16.146394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:16.147465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:16.147465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:16.147465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:16.147465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:16.149446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 410/823] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:16.150308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:16.150921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.189061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:16.232529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e935bf-1fe5-4ab7-9da2-fb060b256db5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.257827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64797d75-3716-4fb2-8c32-4ffbbc4b8745 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.269828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.270506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.270990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.271189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.271956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:16.272257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.278430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.289262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 414/824] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:16.289262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.308995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.310093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.310536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.310966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.318625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.320355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:16.335829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:16.336875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:16.337970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:16.340350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 411/825] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:16.341287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.389691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:16.398643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea361f11-4aee-409c-937d-04f4a97949b3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.434186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.435071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.435205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.435443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.436167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:16.436477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.437921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.450600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 415/826] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:16.451745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.452176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f9306-6e9b-4cd5-beaa-fc1e97059a9d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.455486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:16.490188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.491038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.491456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.491864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.492754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.494340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.522881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 412/827] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:16.524452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.558945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbb9c4-2ec8-4637-af34-91865f7655b6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.603060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.603769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.604054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.604339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.605207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:16.605523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.607006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.624954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 416/828] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:16.626294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.644068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:16.757686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41170cf6-369f-4c6f-8607-c2428f8ef17d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.820343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.821160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.821439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.821711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c982-ae60-4def-a0c3-a7c931919c31 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:16.821839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.830804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.832315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:16.851243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:16.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:16.853028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:16.853970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 413/829] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:16.859045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:16.863704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:16.864432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:16.864722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:16.865114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:16.866013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=ff4b9a16037c4657bd7710297746ad4e) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:16.866322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:16.867854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:16.878059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:16.880396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 417/830] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/role_assignments?user.id=ff4b9a16037c4657bd7710297746ad4e&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:16.994501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b123f-dd81-430a-aa14-a6b5ecc6e521 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:17.033939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:17.034923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.035375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.035791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.036732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:17.037200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:17.038847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e928f-ad73-46bb-aeaf-d6740d8391cd None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:17.054152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 414/831] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:17.060170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:17.159023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:17.192723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6a683-d2a1-45de-9304-2a4b0d58e574 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:17.200869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed3dce-e4d9-4c2d-bbe8-3de0440ee070 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.201368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed3dce-e4d9-4c2d-bbe8-3de0440ee070 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.201445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed3dce-e4d9-4c2d-bbe8-3de0440ee070 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.202760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 415/832] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:17.209060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.209434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.209779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.229260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:17.230584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:17.232181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:17.233429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.233947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.234397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/7a55b74ae1f54fbd81f9459c12f0e10f/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.236743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=7a55b74ae1f54fbd81f9459c12f0e10f, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:17.238404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:17.257786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 418/833] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:04:17 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/7a55b74ae1f54fbd81f9459c12f0e10f/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:04:17.311365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:17.316652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 416/834] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:17.343703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:17.457409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96aaaf1-6545-4905-88e7-48b31242d455 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:17.488039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:17.493803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:17.494912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.495481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.496409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.509527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:17.517690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:17.518597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:04:17.519474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:17.522265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 419/835] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:04:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:17.527809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:17.635591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c33a-62f9-40eb-876d-d2f8e49ef9a9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:17.671449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:17.672129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.672411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.672680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.673477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:17.673784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:17.675185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:17.684186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 417/836] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:04:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:17.689533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:17.793178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2dc1a-6dd1-4b9c-90bf-cbc78beb3391 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:17.832792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:17.833859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:17.834288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:17.834706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:17.845953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:17.847667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:17.867376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:17.868519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:17.869611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:17.869611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:17.869611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:17.869611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:17.871849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 420/837] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:17.880628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:17.942137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:17.981698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b8693-911c-4da1-beec-d3770e1434bb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.015869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.016692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.017064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.017451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.018272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:18.018675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.020182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f75d15-d7d5-4983-b998-190c808fda9f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.032966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 418/838] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:18.040310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.052751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c07c-3121-436e-8193-130a2993969e None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.052963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c07c-3121-436e-8193-130a2993969e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.053232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62c07c-3121-436e-8193-130a2993969e None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.054710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 419/839] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:18.059495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.059778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.060047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.078220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:18.079445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:18.097525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:18.155201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 420/840] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:18.158515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e394b-d817-4d79-83a0-c7cf32b3794f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.177424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.196892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.197711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.197982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.198246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.209653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.211105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:18.225643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:18.226680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:18.228088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:18.233121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 421/841] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:18.233856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.259668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:18.299494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5fc62-ef2e-4bc6-b6f7-5933b703a662 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.333961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.334716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.334993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.335291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.335941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.337315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:18.349199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:18.350246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:18.351069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:18.352597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aec73f-e70b-4e6c-8419-dc12aec6cdb8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.355936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 421/842] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:18.356061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:18.356368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.391721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.392873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.393351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.393859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.394912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:18.395448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.397259 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.416592 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 422/843] 10.222.0.45 () {56 vars in 1149 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:18.422294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.473915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99950d-9725-420a-b042-84591b9961f9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.494640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:18.518904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.519923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.520215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.520490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.521519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:18.521883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.523454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.531194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 422/844] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:18.535144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.549727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79111eff-8b4a-4193-a78e-f720b7d01887 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.599767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.600724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.601365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.602172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.633247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:18.662760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21377663-6c24-4423-b4b1-7e8da0a3105c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.673782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.675362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.699555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.700549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.701005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.701452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.702326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:18.702806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.704392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.709635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 423/845] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:18.788794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 423/846] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:18.794870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:18.846134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:18.907661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c74a4-a663-4f98-b9f5-4fd70ba10e70 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:18.943792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:18.944785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:18.945159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:18.945525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:18.957115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:18.958843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:18.977115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:18.978205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:18.979300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:18.979300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:18.979300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:18.979300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:18.981074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 424/847] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:18.986646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.048242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:19.098052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44729431-7202-48d5-88e0-492d5aa8dcde None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.131970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.132637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.132914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.133183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.133894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:19.134194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:19.135609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:19.148174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 424/848] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:19.153688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.260578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:19.272624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc855a-ece1-4c2e-9889-5be619999f68 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.307145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.308039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.308320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.308591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.315514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:19.316974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-22b5f7ba-98b3-42e3-a245-cb65de2572ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:19.332404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:19.333325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:19.334191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 425/849] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:19.341425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.399485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b48f9-c1c7-4c46-a13a-0a68a95b4c7a None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.399807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b48f9-c1c7-4c46-a13a-0a68a95b4c7a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.400045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b48f9-c1c7-4c46-a13a-0a68a95b4c7a None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.401838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 426/850] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:19.407184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3de1b-c231-45f6-bb9f-8332a541da0b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.407820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3de1b-c231-45f6-bb9f-8332a541da0b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.408196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3de1b-c231-45f6-bb9f-8332a541da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.428365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-94c3de1b-c231-45f6-bb9f-8332a541da0b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:19.430001 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-94c3de1b-c231-45f6-bb9f-8332a541da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:19.452806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95caa6-bddd-4b63-8789-8f18798a506d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.477028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:19.490279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.491070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.491386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.491668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.492464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:19.492773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:19.494237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:19.507123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 425/851] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:19.513200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.524074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 427/852] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:19.538621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab830b-7f5c-475a-b653-9051ba4fc745 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.539315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab830b-7f5c-475a-b653-9051ba4fc745 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.539803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab830b-7f5c-475a-b653-9051ba4fc745 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.541655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 428/853] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:19.545827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab830b-7f5c-475a-b653-9051ba4fc745 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.621015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64b4be-7e1d-4222-bdb6-165dec58ce51 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.647552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:19.658893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.659646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.659937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.660207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.661036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=e28dd040159544d7a4ce050fa593dcc1) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:19.661434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:19.662792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13e211-8685-43ae-82d0-4902ed357359 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:19.666706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab830b-7f5c-475a-b653-9051ba4fc745 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.670714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 426/854] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/role_assignments?user.id=e28dd040159544d7a4ce050fa593dcc1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:19.671206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.671483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.671837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.690179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:19.691501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:19.729202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.730589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.731077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.731606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.733891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:19.735695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:19.742227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:19.756114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:19.757128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:19.757952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:19.766597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 429/855] 10.222.0.45 () {56 vars in 1132 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:19.768367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.787353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 427/856] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:19.806155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.905273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf2562-b149-4de4-9d99-92b891a58a72 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.927995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f557202-5b59-47d2-a346-f624f2da0fb0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:19.960798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.961569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.961855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.962134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.962831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:19.963481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:19.964850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:19.971604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:19.971957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 430/857] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:19.972543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:19.972819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:19.973079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:19.978370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:19.985860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:19.994875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:19.996104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:20.001967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 428/858] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:20.003570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:20.008202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:20.059747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:20.114874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8261ab-aaf5-4adf-9a0e-28fd69bcfe10 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:20.129802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028dc36-86c9-435b-94f9-84c0c202333b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:20.152799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:20.153820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:20.154261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:20.154708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:20.155672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:20.156326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:20.157995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:20.164431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 431/859] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:20.168264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:20.169276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:20.169810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:20.170278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:20.171285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:20.171867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:20.173746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:20.189607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 429/860] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:20.191562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:20.286011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:20.313654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5badc-234b-4d25-b909-ea5c4b7744ef None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:20.353087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:20.353960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:20.354243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:20.354625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:20.366725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:20.368305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:20.387494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:20.388442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:20.389350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:20.389350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:20.389350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:20.389350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:20.389350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 432/861] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:20.395607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:20.495672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:20.499825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684627c-f5f2-40e4-a718-74ea592e32c5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:20.536718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:20.537525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:20.537806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:20.538080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:20.538805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:20.539121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:20.540540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:20.553447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 430/862] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:20.558987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:20.669592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ced21f-ad9c-4b96-837b-475f91080630 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:20.700394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:20.706382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:20.707232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:20.707523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:20.707804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:20.716111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:20.717946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:20.732251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:20.733217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:20.734617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 433/863] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:20.739428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:20.843660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76025795-97b6-4e8b-8ac7-6fd60610ba96 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:20.882122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:20.882826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:20.883109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:20.883420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:20.884267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:20.884571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:20.886066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a29b6-1c34-4e7d-9731-30b3959ded9a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:20.905672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 431/864] 10.222.0.45 () {56 vars in 1135 bytes} [Wed May 25 16:04:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:20.911559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:21.025364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e9c28-89b5-4e98-ba5e-f473e069b2ef None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:21.041664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52a469-8f25-4013-af5e-264301352251 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.042079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52a469-8f25-4013-af5e-264301352251 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.042262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52a469-8f25-4013-af5e-264301352251 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.044235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 432/865] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:21.049355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.049641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.049919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.062407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:21.063392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.063727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.064006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.066864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:21.068098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:21.079523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:21.143532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:21.146746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:21.148918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:21.159650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 433/866] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:21.183419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:21.256642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 434/867] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:21.267202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:21.283442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372f21e-7ea5-4a64-b8ad-18ab171b252a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:21.321824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:21.322511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.322795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.323068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.324428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:21.326501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:21.345217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 434/868] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:21 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:04:21.375326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:21.389075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3576b-76bf-449b-abdf-69f317731e5a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:21.438077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:21.438939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.439248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.439524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.451924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:21.453445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:21.473646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:21.474694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:21.475703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:21.475703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:21.475703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:21.475703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:21.475703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 435/869] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:21.482445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:21.492869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:21.597815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb099-15f8-4997-8411-8ed4dae0df1f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:21.632123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:21.632805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.633090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.633365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.634092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:21.634401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:21.635931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:21.648860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 435/870] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:21.656287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:21.761871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cc95b-bcd5-463f-8bb6-c34844e73efc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:21.797777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:21.798580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.798855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.799120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.806127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:21.807648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:21.809480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:21.821837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:21.822754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:21.823731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 436/871] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:21.830631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:21.905477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:21.941904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c19bc-3952-4369-b181-2f2adbc017cf None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:21.980131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:21.980800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:21.981077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:21.981345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:21.982131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:21.982438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:21.983922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb1a29-76f0-4d39-b1d4-8b3286d7e630 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:21.996030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 436/872] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:22.002107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:22.055403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be3c92-2c70-48aa-8881-7f54247ffa12 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.055754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be3c92-2c70-48aa-8881-7f54247ffa12 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.055971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be3c92-2c70-48aa-8881-7f54247ffa12 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.057619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 437/873] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:22.062801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.063090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.063399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.082142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:22.083450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:22.121935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0759f-2963-4535-91b4-5c4f32fc9768 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:22.160981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:22.161881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.162170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.162447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.163562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=7a55b74ae1f54fbd81f9459c12f0e10f) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:22.163879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:22.165315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:22.168354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 438/874] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:22.181864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 437/875] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:22 2022] GET /identity/v3/role_assignments?user.id=7a55b74ae1f54fbd81f9459c12f0e10f&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:22.198937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:22.264461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:22.310467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2c6f1-7844-40a6-b6ce-b477c8d733a1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:22.347278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:22.348120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.348399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.348670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.361594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:22.370427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:22.371555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:22.372401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 439/876] 10.222.0.45 () {56 vars in 1120 bytes} [Wed May 25 16:04:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:22.378569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:22.445393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:22.489064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319fc56-c569-49e3-8ed8-6790411c3e3d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:22.523484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:22.524164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.524500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.524776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.525562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:22.525869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:22.527329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78802f27-041d-4825-a63e-ae1507bb1940 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:22.535907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 438/877] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:04:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:22.541399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:22.561335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e126-d7eb-449f-aa37-c5d2a54a5ad0 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.561676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e126-d7eb-449f-aa37-c5d2a54a5ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.561888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008e126-d7eb-449f-aa37-c5d2a54a5ad0 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.563742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 439/878] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:22.574288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.574619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.574841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.594763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:22.596346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:22.663595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd5d39-483a-44be-a754-df821e172a96 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:22.675266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 440/879] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:22.681175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:22.693566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:22.702358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:22.703925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.704164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.704747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.717929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:22.719475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:22.737537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:22.738476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:22.739630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:22.739630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:22.739630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:22.739630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:22.739630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 440/880] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:22.744213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:22.771651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:22.807299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24db22-d281-4bf3-9a8a-72d068beca22 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:22.843070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:22.844103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.844585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.845035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.845967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:22.847591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:22.848942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd8d8a-81ec-4598-97e2-5aa2adee6439 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:22.871679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 441/881] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:22 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:22.894695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:22.895426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:22.895783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:22.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:22.896778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:22.897082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:22.898519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:22.913004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 441/882] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:22.918693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:23.037276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8552d-0303-4c1c-ad5e-2c27e0788cbc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:23.061963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:23.075975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:23.076891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.077178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.077455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.086273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:23.087804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:23.103656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:23.104710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:23.105661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 442/883] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:04:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:23.112534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:23.141418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:23.217656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a27a9-e692-4d5f-809d-ec9df3b153ec None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:23.252861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:23.253543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.253820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.254091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.254927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:23.255265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:23.256715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:23.274676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 442/884] 10.222.0.45 () {56 vars in 1149 bytes} [Wed May 25 16:04:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:23.280457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:23.385502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3454d58-1687-476f-b662-5826df883d7b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:23.421419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f613-b71d-4957-86c5-1f21eca4d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:23.422099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f613-b71d-4957-86c5-1f21eca4d155 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.422384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f613-b71d-4957-86c5-1f21eca4d155 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.422659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f613-b71d-4957-86c5-1f21eca4d155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.469937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:23.500587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f613-b71d-4957-86c5-1f21eca4d155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:23.502121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f613-b71d-4957-86c5-1f21eca4d155 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:23.609138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 443/885] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:23.614855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:23.681695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ec15-8372-4969-8f25-f39883c56bf3 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.682000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ec15-8372-4969-8f25-f39883c56bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.682182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3ec15-8372-4969-8f25-f39883c56bf3 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.683736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 444/886] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:23.691080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.691635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.692127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.702393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:23.715895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:23.717974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:23.721975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1272d2-c20e-4b30-8aba-03caa342bd5d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:23.762049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:23.763068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.763466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.763856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.778108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:23.780019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:23.802893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:23.803862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:23.804738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:23.804738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:23.804738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:23.804738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:23.806185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 445/887] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:23.807272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 443/888] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:23.809774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:23.813247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:23.838149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:23.934682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f41b0-776a-4d4a-b5c4-6704188cb0f4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:23.966179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af9975-723e-4a64-80bf-5f1ec874a272 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:23.976602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:23.977267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:23.977544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:23.977812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:23.978560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:23.979211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:23.980968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:23.999415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 446/889] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:24.001048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.008531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.009697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.010660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.011183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.012214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.014468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.017157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:24.031686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:24.032754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:24.033666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:24.042224 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 444/890] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:24.044256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.091287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.137365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62709574-2f6a-4788-ad69-a90352d74e30 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.172002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91904387-aaa6-4031-a722-7bc621c169eb None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.174415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.175635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.175635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.175925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.183370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.184658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:24.200635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:24.201594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:24.202516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:24.207056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 447/891] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:24.208121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.214796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.215803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.216298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.216764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.218058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:24.218559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.220511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.227192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 445/892] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:24.232498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.314413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.323725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194be4c-f9cc-40b9-a153-4f7073aec68d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.360508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902c248-a929-418c-bd2a-fd032243b36e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.363039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.378523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.379859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.380526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.381006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.382249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:24.382765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.384893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.398967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.399681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.399957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.400227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.400927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:24.401260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.402341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 448/893] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:24.402852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.409046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.415356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 446/894] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:24.421832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.519307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ceeac-21f6-46b7-8cc3-f973f1681280 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.538790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f8b0a-2631-407a-bacf-f8135365b5d7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.556637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.557306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.557653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.557927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.558792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] RBAC: Adding query filter params (role.id=07632b279e3a410fbc8cf92f808990c1, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=e28dd040159544d7a4ce050fa593dcc1) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:24.559108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.560587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11dbf2-4baf-4670-bd7a-17c3bfe501f4 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.565185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.566219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 449/895] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/role_assignments?user.id=e28dd040159544d7a4ce050fa593dcc1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=07632b279e3a410fbc8cf92f808990c1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:24.567863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d629fb-f5fb-4107-8751-97b5388f824d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.568183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d629fb-f5fb-4107-8751-97b5388f824d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.568461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d629fb-f5fb-4107-8751-97b5388f824d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.569734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 450/896] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:24.575622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.575902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.576178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.589936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.590794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.591411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.591692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.592515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] RBAC: Adding query filter params (interface=public, service_id=321140b156494163beb063897ead427f, region_id=RegionOne) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:24.592830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.594447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.595099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:24.596517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:24.602454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 447/897] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/endpoints?service_id=321140b156494163beb063897ead427f&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:24.607651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.647962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.676152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 451/898] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:24.703814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.739968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4339e-7bec-46c4-9944-939184bbf3ff None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.778342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.779031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.779341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.779613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.780381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.781906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.788658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 448/899] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:04:24.818559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de0a23-5aeb-45ec-9d22-f1a17bfd039f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:24.859758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:24.860610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:24.860948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:24.861224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:24.861948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:24.863416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:24.877158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:24.878317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:24.879125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 452/900] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:24.885453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:24.949581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:24.999311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4b392-8216-4e61-96ee-583f9980d693 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:25.043390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:25.044001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.044283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.044554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.045280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:25.045587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:25.047005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a3927-b81c-45b6-8326-b34a240e75aa None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:25.053335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 449/901] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:25.059064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:25.119580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:25.184141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926c5e0-cd5d-47d1-89e8-e0ced575a1df None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:25.216296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77c0a5-5960-4d64-b16a-6f96fc9c44d6 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.216586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77c0a5-5960-4d64-b16a-6f96fc9c44d6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.216977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77c0a5-5960-4d64-b16a-6f96fc9c44d6 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.218572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 450/902] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:25.220634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:25.221469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.221923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.222353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.223275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:25.223617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.223905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.224013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:25.224174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.225753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:25.231689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 453/903] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:25.241841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:25.243059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:25.326261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 451/904] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:25.348679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:25.459870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0eea2-5daa-4ea3-98ee-14acff62a6f9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:25.468237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:25.495803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:25.497041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.497517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.498026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.498869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:25.500485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:25.513165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:25.514140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:25.514966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:25.517915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 454/905] 10.222.0.45 () {56 vars in 1132 bytes} [Wed May 25 16:04:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:25.524179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:25.576977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:25.630326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbd7b-b07b-4e93-a4e5-4213e1b45c71 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:25.665930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:25.666604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.666937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.667248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.668314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:25.668677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:25.670082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:25.675463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 452/906] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:25.681025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:25.787456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ebd33-0b9b-40ff-9d8e-d35a2649b05c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:25.823535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:25.824613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.825101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.825564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.826459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:25.826969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:25.828627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:25.834431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 455/907] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:25.840533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:25.950520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f477d-1ae8-486c-9bb1-a21169e06dd1 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:25.964582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:25.987696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:25.988365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:25.988647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:25.988927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:25.989714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] RBAC: Adding query filter params (interface=public, service_id=38e97dc563f541f9b430e4cc9b7876e1, region_id=RegionOne) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:25.990031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:25.991466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c63a3-3de1-4415-9eb2-ee4b3c8f5ec0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:25.997104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 453/908] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:25 2022] GET /identity/v3/endpoints?service_id=38e97dc563f541f9b430e4cc9b7876e1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:26.002521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:26.041379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:26.115772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1dd3a-d94f-41a9-8f04-cd408c73ba73 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:26.154061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f1b91-d4c9-4b71-938e-e8f7dac2adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:26.155101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f1b91-d4c9-4b71-938e-e8f7dac2adc5 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:26.155606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f1b91-d4c9-4b71-938e-e8f7dac2adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:26.156177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f1b91-d4c9-4b71-938e-e8f7dac2adc5 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:26.157066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f1b91-d4c9-4b71-938e-e8f7dac2adc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:26.158666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f1b91-d4c9-4b71-938e-e8f7dac2adc5 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:26.165424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 456/909] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:26 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:04:26.872644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804f0f-3524-4322-8d58-ed84d5f6ae03 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:26.873213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804f0f-3524-4322-8d58-ed84d5f6ae03 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:26.873213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72804f0f-3524-4322-8d58-ed84d5f6ae03 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:26.874829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 454/910] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:26.880238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:26.881072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:26.881542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:26.899186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:26.900715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:26.978435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 457/911] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:27.001408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72804f0f-3524-4322-8d58-ed84d5f6ae03 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.109339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72804f0f-3524-4322-8d58-ed84d5f6ae03 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.149764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef94636-9f61-4adb-858f-42cc755e9384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.150513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94636-9f61-4adb-858f-42cc755e9384 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.150786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94636-9f61-4adb-858f-42cc755e9384 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.151054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef94636-9f61-4adb-858f-42cc755e9384 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.162314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef94636-9f61-4adb-858f-42cc755e9384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-8ef94636-9f61-4adb-858f-42cc755e9384 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:27.170763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:27.171707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:27.172536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 455/912] 10.222.0.45 () {56 vars in 1120 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:27.180273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.194522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748139a4-e623-4c6e-93ee-5eb25f88f6f5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.194800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748139a4-e623-4c6e-93ee-5eb25f88f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.195080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748139a4-e623-4c6e-93ee-5eb25f88f6f5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.196694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 456/913] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:27.203673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.204196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.204481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.216524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.225163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:27.227270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:27.262864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.315366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368eae89-71df-45a1-9451-4216468b5cf7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.321687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 457/914] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:27.340637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.359886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.360563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.360845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.361211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.361910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:27.362670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.363956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.372860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 458/915] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:27.378781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.452435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf404b-078a-48ed-a690-d8eddbdd9ee0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.472253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.482453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0585b-00b7-4063-9cd4-5163c1646fee None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.492722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.493887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.494380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.494876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.495914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.497621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-af6531a4-4fa1-4d7b-97b8-43b6ccbfa5a9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:27.510380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:27.511468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 16:04:27.512508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:27.520252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.520431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 458/916] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:27.520516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.520516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.520516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.520874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251b0a0-fecc-4330-9e8a-a1a3c5368e1e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.521115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251b0a0-fecc-4330-9e8a-a1a3c5368e1e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.521545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251b0a0-fecc-4330-9e8a-a1a3c5368e1e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.522876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 459/917] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:27.524329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251b0a0-fecc-4330-9e8a-a1a3c5368e1e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.531770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.533255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-71b12fbf-aaf1-400c-b298-cbce1cb8479b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:27.551336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:27.552241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:27.553172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:27.553172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:27.553172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:27.553172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:27.553172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 459/918] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:27.554062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.554062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.554307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.562741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.571765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:27.572942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:27.635866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251b0a0-fecc-4330-9e8a-a1a3c5368e1e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.644832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 460/919] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:27.646163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.670476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.671193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.671498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.671757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.672516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:27.673160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.674570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.679571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 460/920] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:27.680269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.734092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.768098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ae164-98fc-4beb-bd69-5ba6255c9972 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.776993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.784528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8327-53c7-4bba-806d-2191c3e39836 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.806112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.806890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.807198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.807565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.808361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:27.808671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.810159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.818277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.818958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.819268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.819545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.820316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.821648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.827071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 461/921] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:27.827071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.838355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 461/922] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:27 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:27.839832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.938799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e2df9-e755-49a6-8ef5-88f5a66e552b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.977955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.991732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.992679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.993114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.993522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.994045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b948fd7-9a4a-40d1-9b22-da978d12223f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.995049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:27.995552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.997336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.008774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 462/923] 10.222.0.45 () {56 vars in 1114 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:28.010451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.032163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.033004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.033284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.033558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.042764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.044284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:28.061443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:28.062632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:28.063884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:28.068226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 462/924] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:28.073912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:28.143531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ae907-86b8-4197-9b7b-c50ba1fe8878 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.180028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.180692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.180879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.181149 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.181945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.183356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.215187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 463/925] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:04:28.215438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a174e-52aa-44e3-976c-e859e1c45cc3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.261705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.262298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.262573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.262847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.263768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:28.264075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.265680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde3d1e-7480-4cd9-9f25-c83a666f7202 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.291423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 463/926] 10.222.0.45 () {56 vars in 1149 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:28.293489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.353266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:28.406172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23a22-eefa-47d0-834b-81143911fe45 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.406538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23a22-eefa-47d0-834b-81143911fe45 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.406715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23a22-eefa-47d0-834b-81143911fe45 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.408111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2e370-5664-4798-8c6d-bebaa9d0ffc8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.408504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 464/927] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:28.415168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.415472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.415751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.435566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:28.436774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:28.457602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.458432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.458850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.460049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.481972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.483505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:28.505866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:28.506802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:28.507792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:28.507792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:28.507792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:28.507792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:28.507792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 464/928] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:28.513739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.517505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:28.525170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 465/929] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:28.548288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.633793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:28.639114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22839489-47fd-4212-9c88-6eac2efbe4d3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.663503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d05b-5169-4f7e-ad72-6308b77cf1c4 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.684434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.685281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.685648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.686007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.687177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:28.687313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.688760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.701954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.703056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.703494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.703914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.704693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.706221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.706726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 465/930] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:28.707743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:28.720310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:28.721448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 16:04:28.722494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:28.730067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 466/931] 10.222.0.45 () {56 vars in 1132 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:28.731131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.794895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:28.819295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787872c-b789-4d26-8ac9-ded69cad91c2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.841143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff67f3-7337-4db7-be07-1bd1ecb740d2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:28.864601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.866313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.866751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.867449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.877451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.879562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.883518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:28.884248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:28.884623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:28.884989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:28.886129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:28.886523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:28.888032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:28.899638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 467/932] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:28.902378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:28.903282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:28.904325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:28.904747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.910194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 466/933] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:28.911055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:28.935012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:29.017334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c4ae-a4ed-4950-8ee6-fde19698bcf6 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:29.041292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13639d0-7463-4318-a602-fdf9cf9fefa9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:29.064552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:29.065620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:29.066119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:29.066585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:29.067630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:29.068361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:29.069794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:29.076228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:29.090465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 467/934] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:29.095970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:29.097869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:29.098547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:29.098825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:29.099094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:29.099906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:29.100200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:29.101961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:29.111897 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 468/935] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:29.112946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:29.211574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:29.219245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2861f2-5e43-4851-94ac-169f924174ff None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:29.238294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf9524-ed8a-4d38-a8a4-ae375d3b72a2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:29.255352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab042c5-7284-48a7-bc2c-eb2139f2977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:29.256148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab042c5-7284-48a7-bc2c-eb2139f2977d None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:29.256514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab042c5-7284-48a7-bc2c-eb2139f2977d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:29.256876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab042c5-7284-48a7-bc2c-eb2139f2977d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:29.257916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab042c5-7284-48a7-bc2c-eb2139f2977d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:29.259253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab042c5-7284-48a7-bc2c-eb2139f2977d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:29.282215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28df48-9fb5-4837-80c6-cacb8cb2087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:29.283444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28df48-9fb5-4837-80c6-cacb8cb2087f None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:29.283913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28df48-9fb5-4837-80c6-cacb8cb2087f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:29.284370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28df48-9fb5-4837-80c6-cacb8cb2087f None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/e28dd040159544d7a4ce050fa593dcc1/roles/07632b279e3a410fbc8cf92f808990c1` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:29.287184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 469/936] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:29.296218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28df48-9fb5-4837-80c6-cacb8cb2087f None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=e28dd040159544d7a4ce050fa593dcc1, role_id=07632b279e3a410fbc8cf92f808990c1)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:29.298192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28df48-9fb5-4837-80c6-cacb8cb2087f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:29.317052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 468/937] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:04:29 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/e28dd040159544d7a4ce050fa593dcc1/roles/07632b279e3a410fbc8cf92f808990c1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:04:30.176474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610af2e-6852-4acd-88ea-661481fd1d25 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.177005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610af2e-6852-4acd-88ea-661481fd1d25 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.177005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610af2e-6852-4acd-88ea-661481fd1d25 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.178755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 470/938] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:30.184410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.184885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.184993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.202758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:30.203983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:30.285704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 469/939] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:30.305998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610af2e-6852-4acd-88ea-661481fd1d25 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:30.354839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:30.417339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610af2e-6852-4acd-88ea-661481fd1d25 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:30.451754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:30.452571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.452855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.453130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.453787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:30.455194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-39b31b31-243a-497e-b1fa-51963929fc83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:30.467718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:30.468788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:30.469643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.474312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 471/940] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:30.475879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:30.545415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187657d-ff7a-4a27-8404-f2d07800f032 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.545775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187657d-ff7a-4a27-8404-f2d07800f032 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.545951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187657d-ff7a-4a27-8404-f2d07800f032 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.546340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:30.547361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 472/941] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:30.552788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.553103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.553389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.573130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:30.574441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:30.589407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a372d-df06-4747-903c-7fb87cd5e5de None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:30.627651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:30.628336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.628612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.629764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.630488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:30.630792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:30.632448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:30.638043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 470/942] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:30.644302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:30.655257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 473/943] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:30.674869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:30.710786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:30.772431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc952165-14f5-461e-8cc3-ddbaa96b6f07 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:30.789217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40876e80-aa6d-4bc5-8211-a08769a9c80d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:30.808962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:30.815957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:30.816860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.817514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.817907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.819131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:30.819573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:30.821353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:30.834125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 471/944] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:30.835780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:30.836487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:30.837270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:30.837554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:30.837832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:30.838544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:30.840141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:30.841581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING keystone.server.flask.common [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 16:04:30.861460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.sql.core [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 16:04:30.861460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 16:04:30.861460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [parameters: {'id': 'e5505f5eff8b447688c5ba310b5be78c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 16:04:30.861460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80441) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5505f5eff8b447688c5ba310b5be78c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5505f5eff8b447688c5ba310b5be78c. May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application conn.query(q) May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:04:30.879342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application result.read() May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 16:04:30.880195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application next(self.gen) May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application yield resource May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application next(self.gen) May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self.session.rollback() May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self.force_reraise() May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise self.value May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application session.commit() May 25 16:04:30.881626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._prepare_impl() May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self.session.flush() May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._flush(objects) May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application compat.raise_( May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application flush_context.execute() May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 16:04:30.882779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rec.execute(self) May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 16:04:30.883728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application conn.query(q) May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application result.read() May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:04:30.884497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [parameters: {'id': 'e5505f5eff8b447688c5ba310b5be78c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:30.885371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:30.887800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e5505f5eff8b447688c5ba310b5be78c. May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 474/945] 10.222.0.45 () {60 vars in 1140 bytes} [Wed May 25 16:04:30 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:30.889653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:30.961207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4007af-20f4-4bd5-9aa3-3a919a8ecb00 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:30.988404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:30.998696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7a64-5bbc-4848-bc30-7a2de9c8458c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:31.003515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:31.004425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.004904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.005364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.006387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] RBAC: Adding query filter params (interface=public, service_id=26c812c7afdb46f4895aca2908157733, region_id=RegionOne) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:31.006880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:31.008635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:31.019639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 472/946] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:30 2022] GET /identity/v3/endpoints?service_id=26c812c7afdb46f4895aca2908157733&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:31.021242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:31.037421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:31.038332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.039096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.039521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.048892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:31.051273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:31.069445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:31.070381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:31.071710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:31.075235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 475/947] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:31.076791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:31.119602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:31.157100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39321e93-4863-4bd7-a8b7-ad89d9d23fe6 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:31.184370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e6b92-8639-4853-92f5-a8ed2e90da3d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:31.205597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c75fbf-cb8d-4a20-a06f-34a4e1b0e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:31.207061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75fbf-cb8d-4a20-a06f-34a4e1b0e968 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.207586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75fbf-cb8d-4a20-a06f-34a4e1b0e968 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.208086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c75fbf-cb8d-4a20-a06f-34a4e1b0e968 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.208979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c75fbf-cb8d-4a20-a06f-34a4e1b0e968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:31.210609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c75fbf-cb8d-4a20-a06f-34a4e1b0e968 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:31.217534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 473/948] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:31 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:04:31.231885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:31.233019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.233518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.234025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.235003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:31.235542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:31.237379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5578-26ad-43a7-86d0-a81082f6f324 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:31.263374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 476/949] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:31.583095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3b333-c902-4d0e-a24d-5387cef224a9 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.583503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3b333-c902-4d0e-a24d-5387cef224a9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.583676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3b333-c902-4d0e-a24d-5387cef224a9 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.585278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 474/950] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:31.590901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.591220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.591505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.609302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:31.610816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:31.619392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:31.673467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd373-953f-447f-8bcf-b7d284bf9206 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.673794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd373-953f-447f-8bcf-b7d284bf9206 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.674028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dd373-953f-447f-8bcf-b7d284bf9206 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.675841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 475/951] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:31.680967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.681219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.681457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.687335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 477/952] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:31.701308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:31.702498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:31.710039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:31.783267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 476/953] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:31.797686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:31.812286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae2ad-7d54-42a6-9700-6a83d326786e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:31.855078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:31.855763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:31.857843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.858470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.859243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.877159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:31.885793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:31.886771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:31.887718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 478/954] 10.222.0.45 () {56 vars in 1120 bytes} [Wed May 25 16:04:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:31.894192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:31.898612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:31.920187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6094c-b709-40fb-88e3-5ff04b47d831 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:31.965131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:31.966366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:31.966818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:31.967380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:31.967962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:31.969518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:31.982531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:31.983775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:31.984636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:31.987559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 477/955] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:31.990365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.038016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61e20d-2697-4b82-9b1a-2a99ceba1f3e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.089853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.090552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.090877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.091174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.091935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:32.092490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.093698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.107079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 479/956] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:04:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:32.108088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.119123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ee2c4-efa4-48a1-a91c-fc3a15cca8d1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.141174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:32.164368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.165313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.165738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.166306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.167318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:32.168211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.170535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.175911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:32.177162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 478/957] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:32.183118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.228877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302234-1198-429a-aed5-b0a36fbd84c4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.266067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.267520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.267942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.268336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.280162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.281743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:32.301173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:32.302265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:32.303409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:32.303409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:32.303409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:32.303409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:32.309689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 480/958] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:32.310653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.317060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e9532-41ee-48c2-b652-cb965c8e0c5f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.360942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.362432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.362983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.363438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.364314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:32.365046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.366967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.373722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 479/959] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:32.429101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca98d3-2d3e-493d-bc94-82a16033f297 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.460394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:32.470896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.472034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.472495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.472976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.473887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:32.474390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.476022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.491484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 481/960] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:32.497513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.559572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:32.607269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a455cd8-a2c9-48ad-a507-c60134dfd07b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.641243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.642404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.642918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.643398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.651216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.652942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:32.673722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:32.674780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 16:04:32.676436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:32.679662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 480/961] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:04:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:32.685669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.789021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5fd8e-d93b-4c14-b374-bd65082caf49 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.824656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:32.825688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:32.826144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:32.826585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:32.827617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:32.828114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:32.829805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:32.847889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 482/962] 10.222.0.45 () {56 vars in 1149 bytes} [Wed May 25 16:04:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:32.853929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:32.960375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba2a66-e2ae-4a29-ae7a-9e5ef7471a30 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:32.963726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:33.000353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:33.001449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.001942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.002410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.083176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:33.083176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:33.189648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 481/963] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:33.195332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.230481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:33.303360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a406fa7-a446-41e5-8697-caf293f20776 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:33.341985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:33.342827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.343108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.343418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.355728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:33.357237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-137e9dbb-fdbf-4bcb-9407-f24a367d291d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:33.376580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:33.377556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:33.378480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:33.378480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:33.378480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:33.378480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:33.378480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 483/964] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:33.383724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.387439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:33.495207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10551b-2038-4ece-85be-c6efa0e2d8e8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:33.531721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:33.532390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.532591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1b28-fd77-4446-9b49-f110d2bf0d3c None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.532765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.532918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1b28-fd77-4446-9b49-f110d2bf0d3c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.533068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.533214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1b28-fd77-4446-9b49-f110d2bf0d3c None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.533634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:33.533938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:33.535354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:33.535964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 484/965] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:33.540202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216a5d-f589-4ba4-a4ec-b9ada28b15ac None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.540485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216a5d-f589-4ba4-a4ec-b9ada28b15ac None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.540763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b216a5d-f589-4ba4-a4ec-b9ada28b15ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.548621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 482/966] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:33.554045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.559124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5b216a5d-f589-4ba4-a4ec-b9ada28b15ac None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:33.560548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5b216a5d-f589-4ba4-a4ec-b9ada28b15ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:33.625715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:33.632395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 485/967] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:33.633742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1d959-568a-4ffb-9328-03ad23422a06 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.634031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1d959-568a-4ffb-9328-03ad23422a06 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.634308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1d959-568a-4ffb-9328-03ad23422a06 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.635628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 486/968] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:33.645342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.645715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.646063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.668811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:33.669999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:33.670316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1be2-0b9f-4808-ae44-2910333f046c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:33.684654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:33.707106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:33.707947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.708231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.708642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.716171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:33.717634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:33.732028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:33.732928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:33.733807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 483/969] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:33.734406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.751267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 487/970] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:33.751267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.839200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59559cfd-8223-4f64-8d3a-4f827c96d2c8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:33.862683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720a4d7-e8ed-4b31-93ab-b1b0375fdab0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:33.864102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:33.877078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:33.878235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.878665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.879096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.879942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:33.881620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:33.894669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:33.895881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:33.896910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:33.897808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:33.897808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:33.898069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:33.898323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:33.899096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:33.899432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:33.904912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:33.905045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 484/971] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:33.905045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.915246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 488/972] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:33.916158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:33.928107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:34.019958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e839fa7-eecd-4e8c-b548-bec1736971ac None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.028529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9a13c-bb96-4680-9f47-32b25688b018 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.057108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.057820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.058101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.058376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.059076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.060582 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.061905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING keystone.server.flask.common [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 16:04:34.064143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.064819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.065096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.065366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.066066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:34.066367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.071476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.080653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 489/973] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:34.080653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:34.082288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.sql.core [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 16:04:34.082288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 16:04:34.082288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [parameters: {'user_id': 'aa4875a3df9244e386f473355949da2d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 16:04:34.082288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80440) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application conn.query(q) May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result.read() May 25 16:04:34.090978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:04:34.092234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application next(self.gen) May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application yield resource May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application next(self.gen) May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.session.rollback() May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.force_reraise() May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise self.value May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application session.commit() May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 16:04:34.093998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._prepare_impl() May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.session.flush() May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._flush(objects) May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application compat.raise_( May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application flush_context.execute() May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rec.execute(self) May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 16:04:34.094915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 16:04:34.095837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result = self._query(query) May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application conn.query(q) May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application result.read() May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 16:04:34.097479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aa4875a3df9244e386f473355949da2d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:34.098525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 16:04:34.099878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 485/974] 10.222.0.45 () {60 vars in 1131 bytes} [Wed May 25 16:04:33 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:34.102637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:34.151961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:34.157208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:34.192267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cf954-41d2-4dc7-82c3-b660369b3cf5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.210787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87d09b-8d32-4262-8a81-6b90d4185cca None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.227112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.227812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.228094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.228367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.229294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] RBAC: Adding query filter params (role.id=07632b279e3a410fbc8cf92f808990c1, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=e28dd040159544d7a4ce050fa593dcc1) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:34.229614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.231073 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.237468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 490/975] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:34 2022] GET /identity/v3/role_assignments?user.id=e28dd040159544d7a4ce050fa593dcc1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=07632b279e3a410fbc8cf92f808990c1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:34.238197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:34.263589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.265048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.265584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.266418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.268092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:34.268866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.271719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.283726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 486/976] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:34.289396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:34.377995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea490b-e90a-4034-bb40-011f6bdb076e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.418163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b148764-d92b-4dbc-85fb-6f2dd1aef2aa None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.425691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.427381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.427845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.428751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.433410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:34.436406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:34.443625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.445741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:34.460571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:34.461705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 16:04:34.462840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:34.465287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 491/977] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:34.469493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34388be9-f284-4871-bb1c-0a01d2f29e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.470331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34388be9-f284-4871-bb1c-0a01d2f29e30 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.471340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:34.471634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34388be9-f284-4871-bb1c-0a01d2f29e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.471921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34388be9-f284-4871-bb1c-0a01d2f29e30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.473305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34388be9-f284-4871-bb1c-0a01d2f29e30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.474194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34388be9-f284-4871-bb1c-0a01d2f29e30 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.501146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 487/978] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:34.609273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94140e9-1ab0-4f20-a070-37ff8b78ba39 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.655216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.655918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.656190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.656462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.657284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:34.657587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.659215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93880a-cec9-4d66-a2e6-c248a51a5abb None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:34.701652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980eda6-1ff0-450c-892f-bbd56fd51072 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.701880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 492/979] 10.222.0.45 () {56 vars in 1101 bytes} [Wed May 25 16:04:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:34.701981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980eda6-1ff0-450c-892f-bbd56fd51072 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.702205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980eda6-1ff0-450c-892f-bbd56fd51072 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.704562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 488/980] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:34.709573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17b9e-848d-4b07-af1e-fe7acd1c3930 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.709904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17b9e-848d-4b07-af1e-fe7acd1c3930 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.710151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a17b9e-848d-4b07-af1e-fe7acd1c3930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.729870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-37a17b9e-848d-4b07-af1e-fe7acd1c3930 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:34.731108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-37a17b9e-848d-4b07-af1e-fe7acd1c3930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:34.784123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:34.817270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 493/981] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:34.840314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980eda6-1ff0-450c-892f-bbd56fd51072 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:34.954858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980eda6-1ff0-450c-892f-bbd56fd51072 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:34.989537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f4669-2b0b-41d4-92e4-b66ac43349f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:34.990212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f4669-2b0b-41d4-92e4-b66ac43349f1 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:34.990491 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f4669-2b0b-41d4-92e4-b66ac43349f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:34.990762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f4669-2b0b-41d4-92e4-b66ac43349f1 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:34.991525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f4669-2b0b-41d4-92e4-b66ac43349f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:34.992910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f4669-2b0b-41d4-92e4-b66ac43349f1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:35.008915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 489/982] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:34 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:36.551552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1277814-deff-4225-a0cf-ad70ee9e52e5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:36.552082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1277814-deff-4225-a0cf-ad70ee9e52e5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:36.552082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1277814-deff-4225-a0cf-ad70ee9e52e5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:36.553517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 494/983] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:36.558992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670119c5-5364-4baf-af94-4085a88156dd None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:36.559479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670119c5-5364-4baf-af94-4085a88156dd None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:36.559559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670119c5-5364-4baf-af94-4085a88156dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:36.576912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-670119c5-5364-4baf-af94-4085a88156dd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:36.578400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-670119c5-5364-4baf-af94-4085a88156dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:36.604150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:36.664520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 490/984] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:36.686892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1277814-deff-4225-a0cf-ad70ee9e52e5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:36.796235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1277814-deff-4225-a0cf-ad70ee9e52e5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:36.808605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6533-3d0e-40f6-af7a-2cd1ce171c34 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:36.808859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6533-3d0e-40f6-af7a-2cd1ce171c34 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:36.809127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6533-3d0e-40f6-af7a-2cd1ce171c34 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:36.810649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 491/985] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:36.815933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:36.816197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:36.816478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:36.832279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:36.833092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:36.833401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:36.833644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:36.834300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:36.835762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:36.837092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:36.838338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:36.851207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:36.852318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:36.853164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 495/986] 10.222.0.45 () {56 vars in 1105 bytes} [Wed May 25 16:04:36 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:36.858675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:36.905335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:36.916378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 492/987] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:36.939242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:36.965761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35244f9-6700-4134-9c9e-18e3a8df69a4 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.002275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.002949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.003258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.003523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.004235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.004543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.005930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.011265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 496/988] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:37.016777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.029472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:37.046385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb678ccb-8921-4959-be74-f0d22d3a7652 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.084153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.084995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.085279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.085542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.086216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.087698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:37.104326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:37.105415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:37.111405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 493/989] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:37.113588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.134302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774691fe-c998-4619-b6e2-7c0d8f25fce0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.144565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:37.175302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.175980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.176255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.176527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.177323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] RBAC: Adding query filter params (type=image) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.177627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.179179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50be3-6498-4dc4-aca0-fe2eaf41364f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.184063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 497/990] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:37.236898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab197b-4777-4d93-9d27-e22f176c47ab None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.266563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e5a1-4ae0-419e-be3f-d7d3588d30a4 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.266818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e5a1-4ae0-419e-be3f-d7d3588d30a4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.267094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e5a1-4ae0-419e-be3f-d7d3588d30a4 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.268720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 498/991] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:37.274269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.274674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.274848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.278235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.278917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.279234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.279509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.280210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.280509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.281918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.287427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 494/992] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:37.293850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.294486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:37.295937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:37.311954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:37.373641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 499/993] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:37.396093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.409188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87230e-4f32-4af6-b1db-30654154dccc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.444465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.445235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.445482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.445782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.446457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.446765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.448209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.453461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 495/994] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:37.459722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.503844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:37.507963 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737557e-818c-4d7a-9f28-4087f48ef5d3 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.544906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:37.545107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.545850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.546133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.546404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.547090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.548493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:37.560270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:37.561729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:37.562659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 500/995] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:37.567380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.572200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f082-7a11-4986-8d02-3c9c161a05e6 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.610409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.611420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.611732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.612011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.613143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] RBAC: Adding query filter params (interface=admin, service_id=26c812c7afdb46f4895aca2908157733, region_id=RegionOne) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.613738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.615309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.622522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 496/996] 10.222.0.45 () {56 vars in 1249 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/endpoints?service_id=26c812c7afdb46f4895aca2908157733&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:37.627933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.674997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d27625-a040-453f-bc7a-923f95f6cb47 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.721665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.722342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.722618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.723095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.724179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.724486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.725884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.730993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 501/997] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:37.733831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d5fc4-d20b-4a74-888f-01bdfd46c953 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.736610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.767522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:37.770062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.770857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.771168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.771458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.772220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.773580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.780113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 497/998] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:04:37.854604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184f68a-f27c-449f-963e-a58376a0b0e5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:37.892698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:37.893287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:37.893564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:37.893841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:37.894545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:37.894848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:37.896305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:37.902168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 502/999] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:37.908044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:37.918454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:38.013541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24d3c4-d251-4e4b-9aa0-3df0169ec5af None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:38.047386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:38.048050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:38.048329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:38.048601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:38.049376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] RBAC: Adding query filter params (interface=public, service_id=ea707c146cfd4ae4b7a196f94d70a09d, region_id=RegionOne) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:38.049687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:38.051066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbc7fd-1cff-48de-b22b-b95e4dc7a96b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:38.056559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 498/1000] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:37 2022] GET /identity/v3/endpoints?service_id=ea707c146cfd4ae4b7a196f94d70a09d&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:38.062218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:38.152467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:38.161497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24897f-ce00-4bb6-be1f-8212186bcf63 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:38.194885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ea150-75d2-442a-b2d5-94aba294c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:38.195581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea150-75d2-442a-b2d5-94aba294c858 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:38.195844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea150-75d2-442a-b2d5-94aba294c858 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:38.196132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ea150-75d2-442a-b2d5-94aba294c858 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:38.196807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea150-75d2-442a-b2d5-94aba294c858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:38.198220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ea150-75d2-442a-b2d5-94aba294c858 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:38.204706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 503/1001] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:38 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:04:39.407745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9c397-c7f4-4146-8182-b12a907531f9 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:39.408283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9c397-c7f4-4146-8182-b12a907531f9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:39.408283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9c397-c7f4-4146-8182-b12a907531f9 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:39.409594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 499/1002] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:39.415036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d30b-8ce2-4c36-bd68-77770135e943 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:39.415496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d30b-8ce2-4c36-bd68-77770135e943 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:39.415594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d30b-8ce2-4c36-bd68-77770135e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:39.433390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4dd4d30b-8ce2-4c36-bd68-77770135e943 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:39.434577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4dd4d30b-8ce2-4c36-bd68-77770135e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:39.503706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 504/1003] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:39.525956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9c397-c7f4-4146-8182-b12a907531f9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:39.599713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:39.635174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9c397-c7f4-4146-8182-b12a907531f9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:39.670684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5837-42d1-463a-bfa4-79750ef28361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:39.671307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5837-42d1-463a-bfa4-79750ef28361 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:39.671593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5837-42d1-463a-bfa4-79750ef28361 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:39.671862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5837-42d1-463a-bfa4-79750ef28361 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:39.672603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5837-42d1-463a-bfa4-79750ef28361 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:39.673985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5837-42d1-463a-bfa4-79750ef28361 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:39.694144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 500/1004] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:39 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:40.037863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e64402-555c-4f9d-bfd8-b16a674353ff None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.038342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e64402-555c-4f9d-bfd8-b16a674353ff None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.038621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e64402-555c-4f9d-bfd8-b16a674353ff None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.040074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 505/1005] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:40.046002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.046260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.046573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.066902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:40.068125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:40.144881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 501/1006] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:40 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:40.168019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e64402-555c-4f9d-bfd8-b16a674353ff None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.264354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:40.282599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e64402-555c-4f9d-bfd8-b16a674353ff None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:40.318276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:40.319002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.319331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.319599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.320253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:40.321634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-4b8712da-a848-4d45-9019-da9cecc7f3dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:40.333885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:40.334848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:40.340395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 506/1007] 10.222.0.45 () {56 vars in 1126 bytes} [Wed May 25 16:04:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:40.343699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.407012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:40.421482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312ae1-31ff-4a19-862c-4ade71b4733b None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.422004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312ae1-31ff-4a19-862c-4ade71b4733b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.422004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2312ae1-31ff-4a19-862c-4ade71b4733b None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.423540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 507/1008] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:40.428669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.428951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.429224 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.448092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:40.449287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:40.458932 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff274d64-0374-437a-b163-a09cf301cc9b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:40.498372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:40.499358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.499776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.500183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.501013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:40.501470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:40.503123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:40.508682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 502/1009] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:40.514305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.531526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 508/1010] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:40 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:40.554912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.630865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2e0e9-6ed8-4255-9121-67c58f7800f7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:40.640160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:40.652446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:40.660181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486a561-d21e-495c-8102-bd537ccf365a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:40.668268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:40.669018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.669300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.669575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.670320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:40.670629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:40.672044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:40.682238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 503/1011] 10.222.0.45 () {56 vars in 1122 bytes} [Wed May 25 16:04:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:40.683070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.696858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:40.697668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.697997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.698270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.698918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:40.700344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:40.712135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:40.713143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 16:04:40.714030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:40.718337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 509/1012] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:40.719552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.789410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5279-be7f-4cd5-afa2-9ffc1cc24135 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:40.823057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd8b57-b87b-489a-a2a0-1cbb7c78255c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:40.827255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:40.827934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.828212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.828481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.829223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:40.830606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:40.850996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 504/1013] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:40.874857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:40.876083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:40.876589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:40.876854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:40.877729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:40.878035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:40.879492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:40.890774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 510/1014] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:40.892125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:40.944779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:41.005871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f34c1-9c73-4ae3-87b7-8bf4c10eabba None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:41.043423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:41.044671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:41.044671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:41.044671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:41.045782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:41.045782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:41.047498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96349f-bb35-454a-abaf-828910135665 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:41.052264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 505/1015] 10.222.0.45 () {56 vars in 1112 bytes} [Wed May 25 16:04:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:41.058183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:41.062208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:41.161231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e92a67-654d-4589-8fb6-0b882b66350a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:41.195824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577fc8c-f4de-4517-a312-92969d07d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:41.196484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fc8c-f4de-4517-a312-92969d07d9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:41.196742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fc8c-f4de-4517-a312-92969d07d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:41.197042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fc8c-f4de-4517-a312-92969d07d9a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:41.197827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577fc8c-f4de-4517-a312-92969d07d9a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:41.199206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577fc8c-f4de-4517-a312-92969d07d9a3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:41.220478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 511/1016] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:04:41.927854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680cfbc-92cb-4004-bd87-31331eb87d83 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:41.928416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680cfbc-92cb-4004-bd87-31331eb87d83 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:41.928416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680cfbc-92cb-4004-bd87-31331eb87d83 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:41.929735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 506/1017] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:41.935424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:41.935832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:41.936002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:41.953770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:41.954965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:42.014968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:42.034995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 512/1018] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:42.057802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680cfbc-92cb-4004-bd87-31331eb87d83 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:42.174704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680cfbc-92cb-4004-bd87-31331eb87d83 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:42.184606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:42.210749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:42.211658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:42.211945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:42.212211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] PATH_INFO: `/v3/services/image` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:42.212859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:42.214311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:42.225799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:42.226810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:42.227882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 507/1019] 10.222.0.45 () {56 vars in 1105 bytes} [Wed May 25 16:04:42 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:42.233095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:42.333879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a32da0-7c06-4cfa-85c0-47cb74659e17 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:42.367352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:42.368078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:42.368361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:42.368634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:42.369414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] RBAC: Adding query filter params (name=image) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:42.369723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:42.371147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:42.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 513/1020] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:42.381891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:42.494595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291e44cc-af3d-4bb7-bffc-451d6f0fcb27 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:42.529440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:42.530114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:42.530356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:42.530658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:42.531381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] RBAC: Adding query filter params (type=image) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:42.531689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:42.533084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:42.538376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 508/1021] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:42.544543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:42.597861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:42.649346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d06115-de91-4242-b799-0cb0065a2599 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:42.691822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:42.692504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:42.692792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:42.693060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:42.693902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] RBAC: Adding query filter params (interface=public, service_id=bf788f66079d463ca84ab33ecba6aa6e, region_id=RegionOne) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:42.694212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:42.695731 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d8207-4ff5-4bdc-82ea-d923a9d61470 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:42.702856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 514/1022] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:04:42 2022] GET /identity/v3/endpoints?service_id=bf788f66079d463ca84ab33ecba6aa6e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:42.708319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:42.747406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:42.817045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2771-da60-41a3-94f7-7a65211f62de None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:42.851783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44f61-5b7c-41a5-aee2-d7754bcc0f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:42.852451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44f61-5b7c-41a5-aee2-d7754bcc0f83 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:42.852732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44f61-5b7c-41a5-aee2-d7754bcc0f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:42.853000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44f61-5b7c-41a5-aee2-d7754bcc0f83 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:42.853676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb44f61-5b7c-41a5-aee2-d7754bcc0f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:42.855121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb44f61-5b7c-41a5-aee2-d7754bcc0f83 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:42.862198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 509/1023] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:04:42 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:04:43.111015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66e56-6cef-4408-a168-e479f37e9205 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.111584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66e56-6cef-4408-a168-e479f37e9205 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.111584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66e56-6cef-4408-a168-e479f37e9205 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.113289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 515/1024] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:43.118462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.118887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.118962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.136781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:43.137933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:43.208041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 510/1025] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:43.231048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66e56-6cef-4408-a168-e479f37e9205 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:43.342409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66e56-6cef-4408-a168-e479f37e9205 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:43.359581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:43.386094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700d0e-4634-4ace-b2c1-aca30f2a23ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:43.386912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700d0e-4634-4ace-b2c1-aca30f2a23ff None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.387185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700d0e-4634-4ace-b2c1-aca30f2a23ff None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.387473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700d0e-4634-4ace-b2c1-aca30f2a23ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.388638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700d0e-4634-4ace-b2c1-aca30f2a23ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:43.390142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700d0e-4634-4ace-b2c1-aca30f2a23ff None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:43.392043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 516/1026] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:43.397759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:43.428550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:43.499451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf331c-578c-4c32-86a6-2eda1a22519e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:43.533344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:43.534128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.534235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6973b87-75f9-418c-959e-43b24579580f None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.534409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.534507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6973b87-75f9-418c-959e-43b24579580f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.534681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.534790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6973b87-75f9-418c-959e-43b24579580f None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.535412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:43.536306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 517/1027] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:43.536843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:43.540997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.541264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.541721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.559016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:43.560293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:43.566059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 511/1028] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:04:43 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:04:43.634310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 518/1029] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:43.657882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:43.750941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:43.773773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89a04f-ccd0-45e7-afda-596e8b7b4452 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:43.808028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:43.808866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.809142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.809387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.819627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:43.827810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:43.828737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:43.829774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 512/1030] 10.222.0.45 () {56 vars in 1120 bytes} [Wed May 25 16:04:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:43.835090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:43.935643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45607682-ff73-4530-862b-18a13ac6eb90 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:43.949120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:43.972239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:43.972919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:43.973166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:43.973464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:43.974203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:43.974508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:43.975980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:43.986665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 519/1031] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:04:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:43.992345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:44.113348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f20ee-6b38-4bd7-8e1d-e1c2b5e70329 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:44.148594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:44.150244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:44.150725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:44.151332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:44.162330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:44.164147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:44.166413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:44.183496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:44.184425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:44.185326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:44.185326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:44.185326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:44.185326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:44.186280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 513/1032] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:44.190661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:44.298005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bc4ce-d4c9-4f7c-ab30-68c15c3985c2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:44.332321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:44.333218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:44.333668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:44.334103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:44.334969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:44.335454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:44.336978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:44.349879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 520/1033] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:44.355248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:44.461008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872df93-f70b-4b54-a669-029ce201dc5b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:44.495633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:44.496433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:44.496690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:44.496983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:44.504750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:44.506269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:44.520461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:44.521464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:44.522405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 514/1034] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:04:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:44.529114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:44.565594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:44.633734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2eb6b-0abf-4834-847b-b81c1b7581fa None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:44.669349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:44.670026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:44.670308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:44.670584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:44.671462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:44.671770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:44.673232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:44.690846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 521/1035] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:04:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:44.696592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:44.760566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:44.811723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c50341-2045-4f51-813d-15e4b92334df None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:44.846756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5d83c-3020-462b-bceb-38ddf1b6f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:44.847428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d83c-3020-462b-bceb-38ddf1b6f574 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:44.847709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d83c-3020-462b-bceb-38ddf1b6f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:44.847978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5d83c-3020-462b-bceb-38ddf1b6f574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:44.922126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d83c-3020-462b-bceb-38ddf1b6f574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:44.923675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5d83c-3020-462b-bceb-38ddf1b6f574 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:44.981368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.029864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 515/1036] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:45.035669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.091299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f1e5c-f721-4c82-86a8-fa787c204d1e None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.091638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f1e5c-f721-4c82-86a8-fa787c204d1e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.091975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f1e5c-f721-4c82-86a8-fa787c204d1e None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.093498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 516/1037] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:45.098417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668595-affb-40d0-b134-4a889b546de2 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.098671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668595-affb-40d0-b134-4a889b546de2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.098971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09668595-affb-40d0-b134-4a889b546de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.116991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-09668595-affb-40d0-b134-4a889b546de2 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:45.118142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-09668595-affb-40d0-b134-4a889b546de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:45.144019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.153895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b560098-6d85-429b-9f65-b56876b37527 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.190550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.191433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.191983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.191983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.193769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 517/1038] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:45.204156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.205630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.216047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668595-affb-40d0-b134-4a889b546de2 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:45.227350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:45.228251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:45.229285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:45.229285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:45.229285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:45.229285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:45.234433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 522/1039] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:45.235506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.305760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.323606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09668595-affb-40d0-b134-4a889b546de2 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.342163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fd346-64c7-4494-9c13-bc783a42a06a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.360054 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.360859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.361138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.361406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] PATH_INFO: `/v3/services/image` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.362052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.363589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:45.375242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:45.376237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:45.377094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 518/1040] 10.222.0.45 () {56 vars in 1105 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:45.381454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.382326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.382444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.382855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.383309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.384203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:45.384656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.387623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.402497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 523/1041] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:45.408333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.414110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.488344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299b3fd-58da-4ec8-9374-7af6ae62a5ef None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.521510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467d6ff-46c8-4983-83a3-48f416b281cc None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.523864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.524537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.524821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.525095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.525866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] RBAC: Adding query filter params (name=image) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:45.526175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.527591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.537290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 519/1042] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:45.538498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.555950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.557104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.557923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.558201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.558559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.565795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.567289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:45.581892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:45.582813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:45.583759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:45.588377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 524/1043] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:45.589223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.654861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf77db4-b741-4f6c-8f91-6ae810bd6edb None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.659507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.694230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.695275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.695707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.696129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.697001 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] RBAC: Adding query filter params (type=image) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:45.697467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.698889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.701239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f06c4-2b11-4c9c-82c0-5a1f514ee7fb None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.704162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 520/1044] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:45.709579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.736800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.737470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.737755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.738026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.738808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:45.739114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.740577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.752685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 525/1045] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:45.758455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:45.791191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.818006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476687-fb25-47d7-bbbe-11ae1f35016d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.851211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec03378-c432-4d4a-aa43-e690aacb3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.851879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03378-c432-4d4a-aa43-e690aacb3534 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.852164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03378-c432-4d4a-aa43-e690aacb3534 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.852436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec03378-c432-4d4a-aa43-e690aacb3534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.853168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec03378-c432-4d4a-aa43-e690aacb3534 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.854645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec03378-c432-4d4a-aa43-e690aacb3534 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.869272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a39b3-1775-4a27-a21a-c385b0dca8f8 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:45.872901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 521/1046] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:04:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:04:45.874239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b203c-edbd-4d1e-8c13-8f16b4b5b491 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.874530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b203c-edbd-4d1e-8c13-8f16b4b5b491 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.874805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b203c-edbd-4d1e-8c13-8f16b4b5b491 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.876543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 522/1047] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:45.882099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.882386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.882658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.897598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:45.902241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:45.903521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:45.918801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:45.919517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:45.919803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:45.920081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:45.920937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] RBAC: Adding query filter params (role.id=07632b279e3a410fbc8cf92f808990c1, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=ff4b9a16037c4657bd7710297746ad4e) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:45.921236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:45.922727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:45.929067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 526/1048] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:45 2022] GET /identity/v3/role_assignments?user.id=ff4b9a16037c4657bd7710297746ad4e&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=07632b279e3a410fbc8cf92f808990c1 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:45.987244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 523/1049] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:46.012622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:46.141344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7d4bd-c5d2-4758-a657-7c5dba414564 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:46.174855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774e608-be3c-4a64-b5cb-22fd0cc0969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:46.175686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e608-be3c-4a64-b5cb-22fd0cc0969f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:46.175961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e608-be3c-4a64-b5cb-22fd0cc0969f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:46.176227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774e608-be3c-4a64-b5cb-22fd0cc0969f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:46.177374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e608-be3c-4a64-b5cb-22fd0cc0969f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:46.178808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774e608-be3c-4a64-b5cb-22fd0cc0969f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:46.180685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 527/1050] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:46.186260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:46.248884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:46.289873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900189e-b7eb-4cbc-ade6-602ce41341a7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:46.326920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32717-00cd-4eb0-81d0-2467da9f6b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:46.327537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32717-00cd-4eb0-81d0-2467da9f6b5e None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:46.327817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32717-00cd-4eb0-81d0-2467da9f6b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:46.328073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32717-00cd-4eb0-81d0-2467da9f6b5e None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:46.328798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc32717-00cd-4eb0-81d0-2467da9f6b5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:46.330246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc32717-00cd-4eb0-81d0-2467da9f6b5e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:46.359181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 524/1051] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:04:46 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:04:48.129686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93dc0-9f43-4754-8b9d-63fc49f127d9 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.130274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93dc0-9f43-4754-8b9d-63fc49f127d9 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.130274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93dc0-9f43-4754-8b9d-63fc49f127d9 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.135193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 528/1052] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:48.137528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.137960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.138067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.142503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f194289-6244-4942-b295-94d221001c46 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.142794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f194289-6244-4942-b295-94d221001c46 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.143077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f194289-6244-4942-b295-94d221001c46 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.144565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 529/1053] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:48.149333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.149614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.149893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.156111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:48.157313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:48.167270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:48.169087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:48.218913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.231210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 525/1054] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:48.243198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 530/1055] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:48.253301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.265521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.305264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.359684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6799ab0-ad8c-476e-993a-cd68a1d71a9f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.375432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5997cfc-5f0c-4762-9ed0-54254aa53b74 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.395057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:48.395745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.396029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.396306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.411833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:48.413154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.413436 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.413861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.427379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:48.435877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:48.436912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:48.437752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:48.442483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 531/1056] 10.222.0.45 () {56 vars in 1120 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:48.443724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.474403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:48.477186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:48.496913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.531611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.566627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0ce3-0805-4831-9572-5b65f00d4cf2 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.586825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 526/1057] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:48.593075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.608730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:48.609675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.610262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.610262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.610957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:48.611360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:48.612781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fd918-2284-4983-8e3a-5097cba03331 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:48.621213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 532/1058] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:48.622428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e7205-d911-4485-83aa-de032ed2a545 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.622768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e7205-d911-4485-83aa-de032ed2a545 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.622983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e7205-d911-4485-83aa-de032ed2a545 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.624355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 533/1059] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:48.628773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e7205-d911-4485-83aa-de032ed2a545 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.692167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf34e61-c5d8-4ab3-82ed-68d67802c91b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.725733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:48.726532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.726816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.727090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.727964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e7205-d911-4485-83aa-de032ed2a545 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.730435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.737603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:48.739299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:48.748196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-13a9ebb2-e801-4b6e-b761-be6bce1236eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:48.758103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:48.759141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:48.760311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:48.760311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:48.760311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:48.760311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:48.760666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 527/1060] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:48.761877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.762161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.762436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.767859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:48.768669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.768998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.769274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.780695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:48.782270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:48.782942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:48.784253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:48.801015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:48.801932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:48.803094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:48.803094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:48.803094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:48.803094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:48.803094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 534/1061] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:48.803762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.862273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 528/1062] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:48.863069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.916736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93ec24-7bbd-4f1c-9b44-878218e29929 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.951071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:48.951749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:48.952028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:48.952301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:48.953015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:48.953322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:48.954711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:48.963427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe1113-5672-4fd1-aa71-e146a6f7271d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:48.966151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 535/1063] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:48.966939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:48.986913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:48.996718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.004325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.005022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.005309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.005584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.006358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:49.006668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.008157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.022823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 529/1064] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:49.028781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.095338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b834b-8621-402c-9f6b-2e07152d681d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.133774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.134591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.134786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.135243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.147520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:49.148826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333bc7de-b949-4743-bbad-908f15391e71 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:49.155443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:49.156462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:49.157424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:49.162327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 536/1065] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:49.163277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.191101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.192030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.192325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.192590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.200392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.201831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:49.219913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:49.220939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:49.221911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 530/1066] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:49.227086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.254503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.279679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498d0f8-29e7-4c22-b0da-bf5d22bbfdab None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.289841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.314808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.315513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.315799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.316071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.316811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:49.317116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.318498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.326920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 537/1067] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:49.332309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.346523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77157ff-8291-421f-8a90-83580be2814c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.379663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.380341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.380631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.380896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.381724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:49.382031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.383508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.401072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 531/1068] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:49.406624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.430385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c0296-ecf3-41de-9d70-f3cc8eb03576 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.463021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.463967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.464248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.464521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] PATH_INFO: `/v3/users/e0793f1713e443dda385596dfad9e37d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.472005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.479045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] RBAC: Authorizing `identity:get_user(user_id=e0793f1713e443dda385596dfad9e37d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.480541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.482242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 538/1069] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/users/e0793f1713e443dda385596dfad9e37d => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:49.487992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.505848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9ad4e-eb0a-4301-89d2-311014d40ef2 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.515072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.540727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.541555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.541833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.542106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.552560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.554006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:49.571395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:49.572378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:49.573390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:49.573390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:49.573390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:49.573390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:49.573390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 532/1070] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:49.578255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.593120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ef373-6bbd-4a53-8bdc-91e5ecbfaf6b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.626497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.627183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.627453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.627738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.677293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad581a-d540-4d36-b5c5-879df7c409f9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.688014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.695169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.696667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.712717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.713403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.713682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.713951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.714666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:49.714969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.716363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.728889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 533/1071] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:49.734473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.756432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.802830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 539/1072] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:49.808643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.835643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b943d6-f267-47e5-88b2-7dd975b88b94 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.869798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.870595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.870872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.871145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.877819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.879292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:49.894320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:49.895229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:49.896146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 534/1073] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:49.899264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:49.901302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.905385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834705b8-f9fe-42bd-95d1-6d8f27b06786 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:49.938789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:49.939601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:49.939882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:49.940141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:49.941329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] RBAC: Authorizing `identity:get_project(project_id=c8aa4d8212894966808018fa38ef9da5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:49.942783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:49.944607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 540/1074] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:49.950587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:49.983432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:50.004151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb35e04-b7ee-49d0-af44-6848f3835a98 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:50.040724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:50.041420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:50.041707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:50.041974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:50.043098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:50.043433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:50.044884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:50.051107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d8da9-ea30-4ef0-85c1-748d0f8183a5 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:50.061343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 535/1075] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:50.062559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:50.086551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:50.087245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:50.087574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:50.087844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:50.088805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=c8aa4d8212894966808018fa38ef9da5, user.id=e0793f1713e443dda385596dfad9e37d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:50.089107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:50.090550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28958a3-65d8-42b4-a6a8-eeb0b987993f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:50.095947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 541/1076] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:49 2022] GET /identity/v3/role_assignments?user.id=e0793f1713e443dda385596dfad9e37d&scope.project.id=c8aa4d8212894966808018fa38ef9da5&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:50.173279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d334e-eb05-4929-9867-24f181ba5940 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:50.212202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcefeb-a30e-4503-90ab-21eb6562a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:50.213068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcefeb-a30e-4503-90ab-21eb6562a965 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:50.213445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcefeb-a30e-4503-90ab-21eb6562a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:50.213725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcefeb-a30e-4503-90ab-21eb6562a965 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/ff4b9a16037c4657bd7710297746ad4e/roles/07632b279e3a410fbc8cf92f808990c1` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:50.216165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcefeb-a30e-4503-90ab-21eb6562a965 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=ff4b9a16037c4657bd7710297746ad4e, role_id=07632b279e3a410fbc8cf92f808990c1)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:50.217634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcefeb-a30e-4503-90ab-21eb6562a965 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:50.229664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:50.237955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 536/1077] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:04:50 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/ff4b9a16037c4657bd7710297746ad4e/roles/07632b279e3a410fbc8cf92f808990c1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:04:52.267003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae29fe7-a82d-47ae-848c-c0c9eff27427 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.267633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae29fe7-a82d-47ae-848c-c0c9eff27427 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.267633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae29fe7-a82d-47ae-848c-c0c9eff27427 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.268986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 542/1078] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:52.274487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e187f0-ce23-4e2b-af08-b92a48b93af5 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.274897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e187f0-ce23-4e2b-af08-b92a48b93af5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.275063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e187f0-ce23-4e2b-af08-b92a48b93af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.293467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-93e187f0-ce23-4e2b-af08-b92a48b93af5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:52.294640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-93e187f0-ce23-4e2b-af08-b92a48b93af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:52.364843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 537/1079] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:52.390884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae29fe7-a82d-47ae-848c-c0c9eff27427 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.398581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865146-fe56-4b62-bbcf-b29d324c382d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.398866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865146-fe56-4b62-bbcf-b29d324c382d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.399130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865146-fe56-4b62-bbcf-b29d324c382d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.400550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 538/1080] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:04:52.405892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.406181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.406569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.420857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:52.424193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:52.425390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:52.492893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 539/1081] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:52.494956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae29fe7-a82d-47ae-848c-c0c9eff27427 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.517239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.532718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:52.533662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.533945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.534220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.544619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:52.552287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:52.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:52.554575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:52.559072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 543/1082] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:52.559996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.577996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:52.619899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a46455-dc8e-41cc-b216-a76a1b0f04bb None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.653624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:52.653816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:52.654449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.654733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.655090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.665601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:52.666678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a951b-2ca4-45e9-8821-3f0db88a1152 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:52.674079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:52.675085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:52.676111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 540/1083] 10.222.0.45 () {56 vars in 1120 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:52.681325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.703003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:52.703721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.704007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.704282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.705022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:52.705322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:52.706703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:52.714929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 544/1084] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:52.720806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.780866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56b35b-537b-4f33-b447-415d7cd43795 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.801240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:52.815397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:52.816067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.816346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.816619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.817365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:52.817669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:52.819047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:52.820303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571940c-65de-4f1c-a025-5ab8be11ad1c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.827212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 541/1085] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:52.832965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.856230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:52.857114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.857395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.857663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] PATH_INFO: `/v3/users/e0793f1713e443dda385596dfad9e37d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.858857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] RBAC: Authorizing `identity:get_user(user_id=e0793f1713e443dda385596dfad9e37d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:52.860836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:52.863621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 545/1086] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/users/e0793f1713e443dda385596dfad9e37d => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:52.869569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:52.889819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:52.938812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cf344-d860-42a1-9f50-031a3d1d69d3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.972492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f8400-59b4-4aed-80b1-91c3b532584b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:52.972670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:52.973418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:52.973700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:52.973975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:52.985199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:52.986671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:53.003870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:53.005029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:53.005925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:53.005925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:53.005925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:53.005925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:53.005925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 542/1087] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:04:53.009698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.010577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.010899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:53.011003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.011178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.012388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] RBAC: Authorizing `identity:get_project(project_id=c8aa4d8212894966808018fa38ef9da5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.013838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.020270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 546/1088] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:04:52 2022] GET /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:53.021217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:53.045576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:53.105496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:53.114383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0689ec0-545c-4397-9da6-9302b4d8c9c9 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:53.120313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9cfbf-8050-4d1e-9084-9b72688c6e43 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:53.148576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.149170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.149445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.149714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.150449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:53.150835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.152257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.156391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.157290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.157571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.157847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5/users/e0793f1713e443dda385596dfad9e37d/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.159816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] RBAC: Authorizing `identity:create_grant(project_id=c8aa4d8212894966808018fa38ef9da5, user_id=e0793f1713e443dda385596dfad9e37d, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.161242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.164403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 543/1089] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:53.170964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:53.178065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 547/1090] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:04:53 2022] PUT /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5/users/e0793f1713e443dda385596dfad9e37d/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:04:53.276307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:53.283963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0834955-a903-4e63-9eb8-304a602c7644 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:53.320990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.321808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.322089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.322362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.330361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.331905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:04:53.347334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:53.348562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 16:04:53.349584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:53.351521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 544/1091] 10.222.0.45 () {56 vars in 1093 bytes} [Wed May 25 16:04:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:53.354650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:53.456096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a72e1a-56c1-4ee1-b385-cbf1fc205c5b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:53.490572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.491333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.491615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.491888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.492729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:53.493037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.494498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.512201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 548/1092] 10.222.0.45 () {56 vars in 1133 bytes} [Wed May 25 16:04:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:53.518117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:53.620915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eff84c-b24c-4794-93d8-fa67bedbb2ea None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:53.658454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.659115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.659448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.659721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.686470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:53.734062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.735474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:53.837333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 545/1093] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:04:53.843599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:53.847890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:53.944885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66ad28-4ca7-4378-ad66-42e47dcd6827 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:53.978118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:53.978938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:53.979211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:53.979507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:53.989584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:53.990951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:04:54.008049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:54.008988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:54.009885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:04:54.009885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:04:54.009885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:04:54.009885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:54.009885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 549/1094] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:54.015118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:54.076510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:54.122517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425ce1-3196-4a0e-9770-8e87b3d3883d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:54.157862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:54.158527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:54.158808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:54.159082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:54.159832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:54.160140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:54.161512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:54.174362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 546/1095] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:54.180348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:54.236721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:54.283172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf630fb-93d2-4bc9-baea-188a2fcd3b6a None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:54.318313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:54.319112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:54.319420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:54.319695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:54.326460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:54.327957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:04:54.341488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:54.342396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:04:54.343328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 550/1096] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:54.348880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:54.449875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e234d5-ce91-4501-a78f-dd34bda43162 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:54.463763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:54.486334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:54.486992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:54.487295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:54.487565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:54.488344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:54.488648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:54.490068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b205c-908d-4df6-bedf-c60e442101c1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:54.501906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 547/1097] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:54.508274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:54.614153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82bf4b-e30c-4621-b697-eef2f3bfa09b None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:54.630114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:54.648453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:54.649101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:54.649387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:54.649658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:54.650538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] RBAC: Adding query filter params (role.id=07632b279e3a410fbc8cf92f808990c1, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=ff4b9a16037c4657bd7710297746ad4e) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:54.651011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:54.652496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737b8c5-e080-42ce-997a-41e531183e59 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:54.658695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 551/1098] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:54 2022] GET /identity/v3/role_assignments?user.id=ff4b9a16037c4657bd7710297746ad4e&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=07632b279e3a410fbc8cf92f808990c1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:04:55.349048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ced01-51e6-4672-ac47-bfc882b72ac8 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:55.349554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ced01-51e6-4672-ac47-bfc882b72ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:55.349554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ced01-51e6-4672-ac47-bfc882b72ac8 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:55.350885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 548/1099] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:55.356606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:55.356880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:55.357147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:55.375439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:55.376629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:55.447466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 552/1100] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:04:55.470643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ced01-51e6-4672-ac47-bfc882b72ac8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:55.579023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ced01-51e6-4672-ac47-bfc882b72ac8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:55.614694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:55.615435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:55.615716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:55.615980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:55.626682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:04:55.634260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:04:55.635454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:04:55.636465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 549/1101] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:04:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:04:55.644537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:55.754278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7c65d-035e-4ad9-ade6-cb24e45c6150 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:55.767377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:55.791987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:55.792949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:55.793234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:55.793505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:55.794243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:55.794548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:55.795956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:55.803887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 553/1102] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:04:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:55.809959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:55.847170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:55.929053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48856e0-3255-4454-ac2b-4fe8512b9b46 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:55.964268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:55.965133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:55.965410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:55.965682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] PATH_INFO: `/v3/users/e0793f1713e443dda385596dfad9e37d` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:55.966866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] RBAC: Authorizing `identity:get_user(user_id=e0793f1713e443dda385596dfad9e37d)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:55.968335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:55.969975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 550/1103] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:04:55 2022] GET /identity/v3/users/e0793f1713e443dda385596dfad9e37d => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:55.976177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:56.086453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804a3d-776d-4c3f-811f-187bfd7b3749 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:56.120451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:56.121087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:56.121368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:56.121640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:56.162627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:56.194089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:56.195512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:56.306209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 554/1104] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:04:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:04:56.315479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:56.429774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6ec8b-0014-4c7c-b933-2f6edee609d3 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:56.431574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:56.467677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48328556-f370-46fd-9bf6-7f1aa2c4d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:56.468462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48328556-f370-46fd-9bf6-7f1aa2c4d879 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:56.468741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48328556-f370-46fd-9bf6-7f1aa2c4d879 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:56.469036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48328556-f370-46fd-9bf6-7f1aa2c4d879 None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:56.470276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48328556-f370-46fd-9bf6-7f1aa2c4d879 None admin] RBAC: Authorizing `identity:get_project(project_id=c8aa4d8212894966808018fa38ef9da5)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:56.471750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48328556-f370-46fd-9bf6-7f1aa2c4d879 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:56.473427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 551/1105] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:04:56 2022] GET /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:56.479762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:56.562908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:56.602183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06094-bf3f-46f5-a4ef-3d5b66b6a804 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:56.641326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:56.641969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:56.642246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:56.642510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:56.643364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=c8aa4d8212894966808018fa38ef9da5, user.id=e0793f1713e443dda385596dfad9e37d) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:04:56.643674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:56.645122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a138060-539f-4fec-9604-eb8cdadfcaea None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:56.651076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 555/1106] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:04:56 2022] GET /identity/v3/role_assignments?user.id=e0793f1713e443dda385596dfad9e37d&scope.project.id=c8aa4d8212894966808018fa38ef9da5&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:58.864498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38752284-9cdd-410c-b800-b1fade25fd5b None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:58.865060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38752284-9cdd-410c-b800-b1fade25fd5b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:58.865060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38752284-9cdd-410c-b800-b1fade25fd5b None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:58.868146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 552/1107] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:04:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:04:58.877361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:58.878059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:58.878207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:58.899124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:04:58.900373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:58.986207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 556/1108] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:04:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:04:59.016036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38752284-9cdd-410c-b800-b1fade25fd5b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:59.126679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38752284-9cdd-410c-b800-b1fade25fd5b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:59.162335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059af70-91a1-447b-8575-0f58bc0aae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:59.163129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059af70-91a1-447b-8575-0f58bc0aae6d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:59.163449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059af70-91a1-447b-8575-0f58bc0aae6d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:59.163722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059af70-91a1-447b-8575-0f58bc0aae6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:59.165000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059af70-91a1-447b-8575-0f58bc0aae6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:59.166472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059af70-91a1-447b-8575-0f58bc0aae6d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:59.168438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 553/1109] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:04:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:04:59.174999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:59.249147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:59.290060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1023a42-52dc-4c90-be83-df9dae7bdf06 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:59.330030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96159-1e3f-40be-886c-2c0476a6a0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:59.330695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96159-1e3f-40be-886c-2c0476a6a0ad None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:59.330970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96159-1e3f-40be-886c-2c0476a6a0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:59.331273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96159-1e3f-40be-886c-2c0476a6a0ad None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:59.331976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96159-1e3f-40be-886c-2c0476a6a0ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:59.333405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96159-1e3f-40be-886c-2c0476a6a0ad None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:59.357171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 557/1110] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:04:59 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:05:01.584667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5987-89ed-41cf-a32e-44a7ce6365f3 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:01.585217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5987-89ed-41cf-a32e-44a7ce6365f3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:01.585217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5987-89ed-41cf-a32e-44a7ce6365f3 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:01.586595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 554/1111] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:01.593056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:01.593752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:01.593927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:01.615184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:01.616408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:01.689690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 558/1112] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:01.713083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed5987-89ed-41cf-a32e-44a7ce6365f3 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:01.759659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:01.821457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed5987-89ed-41cf-a32e-44a7ce6365f3 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:01.858320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:01.859104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:01.859406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:01.859672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] PATH_INFO: `/v3/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:01.861230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] RBAC: Authorizing `identity:get_role(role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:01.862592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:01.863979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 555/1113] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:01 2022] GET /identity/v3/roles/6e9210d695b14e9bb259dbc706a59244 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:01.869862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:01.930889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:01.983460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7e45c-1a4b-4e43-86e5-17a63ebb9231 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:02.019730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:02.020593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:02.020865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:02.021130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] PATH_INFO: `/v3/users/ec641bd90b5f47e5bb3440e1af95f390` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:02.034754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=ec641bd90b5f47e5bb3440e1af95f390)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:02.036293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:02.037918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 559/1114] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:01 2022] GET /identity/v3/users/ec641bd90b5f47e5bb3440e1af95f390 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:02.044202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:02.147047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e755-bfe2-4081-b318-1c2f882f220e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:02.154377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:02.186024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:02.186654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:02.186920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:02.187198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:02.261101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:02.263340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:02.377746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 556/1115] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:02.386537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:02.492970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41936f60-8d42-4ea9-b216-c3c879b81ca6 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:02.503579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:02.539066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce90153-39b2-45c8-95f7-c15d5e652e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:02.540976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce90153-39b2-45c8-95f7-c15d5e652e84 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:02.541264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce90153-39b2-45c8-95f7-c15d5e652e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:02.541541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce90153-39b2-45c8-95f7-c15d5e652e84 None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:02.543137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce90153-39b2-45c8-95f7-c15d5e652e84 None admin] RBAC: Authorizing `identity:get_project(project_id=c8aa4d8212894966808018fa38ef9da5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:02.544616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce90153-39b2-45c8-95f7-c15d5e652e84 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:02.546357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 560/1116] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:02 2022] GET /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:02.552683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:02.561626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:02.661080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92820-8a8b-4a43-87c7-dc4a1d2cd230 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:02.696584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:02.697327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:02.697609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:02.697886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:02.698698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] RBAC: Adding query filter params (role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=c8aa4d8212894966808018fa38ef9da5, user.id=ec641bd90b5f47e5bb3440e1af95f390) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:02.699006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:02.700465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00382-c663-409a-9b80-c228b71cb01c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:02.706055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 557/1117] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:05:02 2022] GET /identity/v3/role_assignments?user.id=ec641bd90b5f47e5bb3440e1af95f390&scope.project.id=c8aa4d8212894966808018fa38ef9da5&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:04.864880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6024-7d80-412c-9f0b-7042ca32038e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:04.865785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6024-7d80-412c-9f0b-7042ca32038e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:04.865785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6024-7d80-412c-9f0b-7042ca32038e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:04.868025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 561/1118] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:04.873500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:04.873918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:04.874023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:04.892495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:04.893661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:04.968230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:04.975792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 558/1119] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:05.000839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6024-7d80-412c-9f0b-7042ca32038e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:05.121463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6024-7d80-412c-9f0b-7042ca32038e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:05.156881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:05.157739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:05.158019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:05.158291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] PATH_INFO: `/v3/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:05.159913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] RBAC: Authorizing `identity:get_role(role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:05.161315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:05.162708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 562/1120] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:04 2022] GET /identity/v3/roles/6e9210d695b14e9bb259dbc706a59244 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:05:05.169274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:05.275470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a395102-fcab-477e-9881-7af3ca36f821 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:05.313216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:05.314095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:05.314371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:05.314642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] PATH_INFO: `/v3/users/ec641bd90b5f47e5bb3440e1af95f390` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:05.315952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] RBAC: Authorizing `identity:get_user(user_id=ec641bd90b5f47e5bb3440e1af95f390)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:05.317393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:05.319040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 559/1121] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:05 2022] GET /identity/v3/users/ec641bd90b5f47e5bb3440e1af95f390 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:05.325240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:05.377697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:05.434820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f8104-7bb9-47b2-94d1-7e21f67f2827 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:05.470053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8869f-9943-4bcf-b6ba-287337d0ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:05.470902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8869f-9943-4bcf-b6ba-287337d0ea2b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:05.471195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8869f-9943-4bcf-b6ba-287337d0ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:05.471472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8869f-9943-4bcf-b6ba-287337d0ea2b None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:05.472772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8869f-9943-4bcf-b6ba-287337d0ea2b None admin] RBAC: Authorizing `identity:get_project(project_id=c8aa4d8212894966808018fa38ef9da5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:05.474205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8869f-9943-4bcf-b6ba-287337d0ea2b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:05.475925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 563/1122] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:05 2022] GET /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:05.485031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:05.556568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:05.591325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479a65d-0b47-4548-8834-6ab01c1a9326 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:05.626896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19713a6-bdec-425b-a425-2863fb885429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:05.627870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19713a6-bdec-425b-a425-2863fb885429 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:05.628136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19713a6-bdec-425b-a425-2863fb885429 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:05.628548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19713a6-bdec-425b-a425-2863fb885429 None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5/users/ec641bd90b5f47e5bb3440e1af95f390/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:05.631183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19713a6-bdec-425b-a425-2863fb885429 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8aa4d8212894966808018fa38ef9da5, user_id=ec641bd90b5f47e5bb3440e1af95f390, role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:05.632800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19713a6-bdec-425b-a425-2863fb885429 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:05.649900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 560/1123] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:05:05 2022] PUT /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5/users/ec641bd90b5f47e5bb3440e1af95f390/roles/6e9210d695b14e9bb259dbc706a59244 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:05:07.797726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535b6b-5dd0-436a-8ca0-2f0e4cb17074 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:07.798702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535b6b-5dd0-436a-8ca0-2f0e4cb17074 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:07.798702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535b6b-5dd0-436a-8ca0-2f0e4cb17074 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:07.801037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 564/1124] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:07.807540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:07.808017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:07.808133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:07.831067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:07.832315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:07.904503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 561/1125] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:07.928524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535b6b-5dd0-436a-8ca0-2f0e4cb17074 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:08.037786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535b6b-5dd0-436a-8ca0-2f0e4cb17074 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:08.053734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:08.077216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:08.078078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:08.078360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:08.078634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] PATH_INFO: `/v3/roles/6e9210d695b14e9bb259dbc706a59244` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:08.080153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] RBAC: Authorizing `identity:get_role(role_id=6e9210d695b14e9bb259dbc706a59244)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:08.081539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:08.082940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 565/1126] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:07 2022] GET /identity/v3/roles/6e9210d695b14e9bb259dbc706a59244 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:08.088899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:08.153340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:08.195630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca86021-6b21-4c8b-8169-e71266140948 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:08.231372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:08.232240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:08.232527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:08.232794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] PATH_INFO: `/v3/users/ec641bd90b5f47e5bb3440e1af95f390` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:08.234043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ec641bd90b5f47e5bb3440e1af95f390)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:08.235538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:08.237158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 562/1127] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:08 2022] GET /identity/v3/users/ec641bd90b5f47e5bb3440e1af95f390 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:05:08.243902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:08.362870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065653-82fd-4483-a10c-75a20d857f20 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:08.399174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:08.400123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:08.400432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:08.400685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:08.452528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:08.478853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:08.480396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:08.593171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 566/1128] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:08.602814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:08.713482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add4caed-e4d9-4421-8903-ce7597b012a7 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:08.739532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:08.752127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c417bd-55df-4200-9fa8-940316523aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:08.752996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c417bd-55df-4200-9fa8-940316523aac None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:08.753278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c417bd-55df-4200-9fa8-940316523aac None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:08.753550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c417bd-55df-4200-9fa8-940316523aac None admin] PATH_INFO: `/v3/projects/c8aa4d8212894966808018fa38ef9da5` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:08.754858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c417bd-55df-4200-9fa8-940316523aac None admin] RBAC: Authorizing `identity:get_project(project_id=c8aa4d8212894966808018fa38ef9da5)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:08.756350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c417bd-55df-4200-9fa8-940316523aac None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:08.758098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 563/1129] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:08 2022] GET /identity/v3/projects/c8aa4d8212894966808018fa38ef9da5 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:08.764485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:08.858802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:08.878290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54831dd-0e63-4b40-abb4-cb18d302807f None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:08.914467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:08.915116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:08.915429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:08.915729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:08.916550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] RBAC: Adding query filter params (role.id=6e9210d695b14e9bb259dbc706a59244, scope.project.id=c8aa4d8212894966808018fa38ef9da5, user.id=ec641bd90b5f47e5bb3440e1af95f390) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:08.916871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:08.918696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57016a-23ed-40e1-9583-d54ebd86d8fd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:08.924655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 567/1130] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:05:08 2022] GET /identity/v3/role_assignments?user.id=ec641bd90b5f47e5bb3440e1af95f390&scope.project.id=c8aa4d8212894966808018fa38ef9da5&role.id=6e9210d695b14e9bb259dbc706a59244 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:11.123755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025d6a-9674-457a-a1ff-9c0bf00f8abc None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:11.124310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025d6a-9674-457a-a1ff-9c0bf00f8abc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:11.124310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025d6a-9674-457a-a1ff-9c0bf00f8abc None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:11.125688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 564/1131] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:11.133833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:11.134275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:11.134380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:11.153162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:11.154325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:11.236734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 568/1132] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:05:11.260168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93025d6a-9674-457a-a1ff-9c0bf00f8abc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:11.376830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93025d6a-9674-457a-a1ff-9c0bf00f8abc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:11.412940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f9cd-1cdf-497a-a555-51043137e58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:11.413744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f9cd-1cdf-497a-a555-51043137e58e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:11.414008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f9cd-1cdf-497a-a555-51043137e58e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:11.414285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f9cd-1cdf-497a-a555-51043137e58e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:11.415525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713f9cd-1cdf-497a-a555-51043137e58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:11.417044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713f9cd-1cdf-497a-a555-51043137e58e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:11.419070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 565/1133] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:05:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:11.425305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:11.503561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:11.528075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976bcd9-0377-48c3-9ad6-2b7ac508e89c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:11.563066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f6e0-21a7-4e52-9dc4-45bf5b49b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:11.563750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f6e0-21a7-4e52-9dc4-45bf5b49b2f1 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:11.564034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f6e0-21a7-4e52-9dc4-45bf5b49b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:11.564302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f6e0-21a7-4e52-9dc4-45bf5b49b2f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:11.565015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f6e0-21a7-4e52-9dc4-45bf5b49b2f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:11.566463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f6e0-21a7-4e52-9dc4-45bf5b49b2f1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:11.600129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 569/1134] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:05:11 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:05:13.826768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9c205-63e8-4dc5-99a9-2bf62a6fce37 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:13.827717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9c205-63e8-4dc5-99a9-2bf62a6fce37 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:13.827717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9c205-63e8-4dc5-99a9-2bf62a6fce37 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:13.829857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 566/1135] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:13.836311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:13.836979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:13.837201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:13.858137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:13.859331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:13.928250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 570/1136] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:13.953041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9c205-63e8-4dc5-99a9-2bf62a6fce37 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:14.023552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:14.069715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9c205-63e8-4dc5-99a9-2bf62a6fce37 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:14.110316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d7091-17dd-4429-ab12-d14b9cf1d97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:14.111039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d7091-17dd-4429-ab12-d14b9cf1d97a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:14.111370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d7091-17dd-4429-ab12-d14b9cf1d97a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:14.111641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d7091-17dd-4429-ab12-d14b9cf1d97a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:14.113018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d7091-17dd-4429-ab12-d14b9cf1d97a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:14.114454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d7091-17dd-4429-ab12-d14b9cf1d97a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:14.116162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 567/1137] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:14.125546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:14.194176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:14.239193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b7b38-ead4-447d-9a18-0630a6b4df91 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:14.277343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab5881-9dfe-49ca-82da-d49ddcf02e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:14.277999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5881-9dfe-49ca-82da-d49ddcf02e7c None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:14.278279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5881-9dfe-49ca-82da-d49ddcf02e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:14.278549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab5881-9dfe-49ca-82da-d49ddcf02e7c None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:14.279279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab5881-9dfe-49ca-82da-d49ddcf02e7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:14.280722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab5881-9dfe-49ca-82da-d49ddcf02e7c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:14.307668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 571/1138] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:05:14 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:05:16.530273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f36956-3de3-417e-89d0-08eee9eb944d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:16.530817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f36956-3de3-417e-89d0-08eee9eb944d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:16.530817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f36956-3de3-417e-89d0-08eee9eb944d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:16.532244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 568/1139] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:16.538629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:16.539386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:16.539558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:16.563640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:16.564827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:16.635100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 572/1140] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:16.658865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f36956-3de3-417e-89d0-08eee9eb944d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:16.783324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f36956-3de3-417e-89d0-08eee9eb944d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:16.827551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:16.836690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:16.837897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:16.838299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:16.838691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:16.855565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:05:16.863259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:16.864440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:05:16.865445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 569/1141] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:16.870748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:16.916351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:16.973114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9e06-6a93-42f4-8366-e4a776abc6de None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:17.011892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:17.012563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:17.012848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:17.013156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:17.013905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:17.014212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:17.015654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:17.023998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 573/1142] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:17.030893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:17.157279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18f40f-f546-4dbb-b9c0-4ced55c08a3c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:17.195758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:17.196641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:17.196944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:17.197211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] PATH_INFO: `/v3/users/278921937ccc48d185a6623ceefb55f5` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:17.210359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] RBAC: Authorizing `identity:get_user(user_id=278921937ccc48d185a6623ceefb55f5)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:17.211861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:17.213561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 570/1143] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:17 2022] GET /identity/v3/users/278921937ccc48d185a6623ceefb55f5 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:17.222497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:17.329650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a903a-ab33-478c-a51e-08b867172020 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:17.336852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:17.365111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:17.365747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:17.366022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:17.366290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:17.434617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:17.436091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:17.540165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 574/1144] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:17.550208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:17.608544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:17.671167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841add9e-ed84-41d4-9cf6-82423dcd4752 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:17.708445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1314d19-ef4c-40fd-9fee-6964980ce622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:17.709338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314d19-ef4c-40fd-9fee-6964980ce622 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:17.709616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314d19-ef4c-40fd-9fee-6964980ce622 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:17.709885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1314d19-ef4c-40fd-9fee-6964980ce622 None admin] PATH_INFO: `/v3/projects/6538286cb7244733a0bf7a6f0df4534e` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:17.711114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314d19-ef4c-40fd-9fee-6964980ce622 None admin] RBAC: Authorizing `identity:get_project(project_id=6538286cb7244733a0bf7a6f0df4534e)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:17.712632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1314d19-ef4c-40fd-9fee-6964980ce622 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:17.714305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 571/1145] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:17 2022] GET /identity/v3/projects/6538286cb7244733a0bf7a6f0df4534e => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:17.724386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:17.734130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:17.831631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4b4b0-574c-4c69-8fd0-2585261699f9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:17.866936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:17.867555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:17.867837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:17.868109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:17.868978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=6538286cb7244733a0bf7a6f0df4534e, user.id=278921937ccc48d185a6623ceefb55f5) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:17.869292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:17.870713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6224331-eabd-4586-80d7-20d801ca4c24 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:17.876154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 575/1146] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:05:17 2022] GET /identity/v3/role_assignments?user.id=278921937ccc48d185a6623ceefb55f5&scope.project.id=6538286cb7244733a0bf7a6f0df4534e&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:20.042564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210dd5-7dfa-4b82-ac69-5527a4e68f4c None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:20.043136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210dd5-7dfa-4b82-ac69-5527a4e68f4c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:20.043136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210dd5-7dfa-4b82-ac69-5527a4e68f4c None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:20.046840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 572/1147] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:20.055572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:20.056531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:20.056531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:20.074070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:20.075265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:20.141351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:20.146810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 576/1148] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 16:05:20.171289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07210dd5-7dfa-4b82-ac69-5527a4e68f4c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:20.282356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07210dd5-7dfa-4b82-ac69-5527a4e68f4c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:20.299968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:20.320233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:20.321032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:20.321312 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:20.321586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:20.332357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:05:20.339950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:20.341031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:05:20.342717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 573/1149] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:05:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:20.351205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:20.456764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d9ab9-9e3e-4ccb-a029-a0fb738e864d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:20.492944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:20.493639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:20.493919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:20.494186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:20.494927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:20.495261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:20.496660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:20.504965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 577/1150] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:05:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:20.511560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:20.613967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be712c0-a8d2-4ebf-9938-16303c05e0f1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:20.657729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:20.658611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:20.658896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:20.659199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] PATH_INFO: `/v3/users/278921937ccc48d185a6623ceefb55f5` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:20.660446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] RBAC: Authorizing `identity:get_user(user_id=278921937ccc48d185a6623ceefb55f5)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:20.661901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:20.663618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 574/1151] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:20 2022] GET /identity/v3/users/278921937ccc48d185a6623ceefb55f5 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:20.673449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:20.749370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:20.798851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a866405-2c79-404a-9021-ffed6323c41d None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:20.842667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05da4-1b4d-48fc-bb5c-8d9599627aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:20.843604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05da4-1b4d-48fc-bb5c-8d9599627aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:20.843883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05da4-1b4d-48fc-bb5c-8d9599627aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:20.844156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05da4-1b4d-48fc-bb5c-8d9599627aa6 None admin] PATH_INFO: `/v3/projects/6538286cb7244733a0bf7a6f0df4534e` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:20.845366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f05da4-1b4d-48fc-bb5c-8d9599627aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=6538286cb7244733a0bf7a6f0df4534e)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:20.846795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f05da4-1b4d-48fc-bb5c-8d9599627aa6 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:20.848516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 578/1152] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:20 2022] GET /identity/v3/projects/6538286cb7244733a0bf7a6f0df4534e => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:20.854863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:20.905166 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:20.969353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b9550-559e-4db5-9ed2-c9f420bd0a30 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:21.012168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a5dd8-bc1a-482d-91ea-d2527eb75d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:21.013050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a5dd8-bc1a-482d-91ea-d2527eb75d8b None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:21.013330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a5dd8-bc1a-482d-91ea-d2527eb75d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:21.013666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a5dd8-bc1a-482d-91ea-d2527eb75d8b None admin] PATH_INFO: `/v3/projects/6538286cb7244733a0bf7a6f0df4534e/users/278921937ccc48d185a6623ceefb55f5/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:21.015651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a5dd8-bc1a-482d-91ea-d2527eb75d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=6538286cb7244733a0bf7a6f0df4534e, user_id=278921937ccc48d185a6623ceefb55f5, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:21.017099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a5dd8-bc1a-482d-91ea-d2527eb75d8b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:21.032825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 575/1153] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:05:20 2022] PUT /identity/v3/projects/6538286cb7244733a0bf7a6f0df4534e/users/278921937ccc48d185a6623ceefb55f5/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:05:23.220870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3139a-8b35-4326-8688-6de88490c2b0 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:23.221775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3139a-8b35-4326-8688-6de88490c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:23.221775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3139a-8b35-4326-8688-6de88490c2b0 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:23.224008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 579/1154] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:23.229481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:23.229928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:23.230025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:23.248434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:23.249596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:23.322706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 576/1155] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:23.346253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3139a-8b35-4326-8688-6de88490c2b0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:23.462793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3139a-8b35-4326-8688-6de88490c2b0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:23.493948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:23.504439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:23.505649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:23.506079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:23.506505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:23.518183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:05:23.525726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:23.526873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:05:23.528015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 580/1156] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:23.533525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:23.569474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:23.638014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369a25-a243-4eba-af4f-80d77c8c1efb None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:23.676669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:23.677341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:23.677625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:23.677900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:23.678654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:23.678962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:23.680403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:23.689132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 577/1157] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:23.695379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:23.822768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a6667-1101-4391-9028-a785e93b20cd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:23.857842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:23.858712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:23.858991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:23.859292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] PATH_INFO: `/v3/users/278921937ccc48d185a6623ceefb55f5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:23.860526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] RBAC: Authorizing `identity:get_user(user_id=278921937ccc48d185a6623ceefb55f5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:23.861978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:23.863630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 581/1158] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:23 2022] GET /identity/v3/users/278921937ccc48d185a6623ceefb55f5 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:23.869891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:23.967936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:23.974366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13df24c-e490-47dd-9bda-783c9c41967b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:24.009350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:24.009983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:24.010262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:24.010541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:24.085677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:24.087972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:24.184807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:24.192087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 578/1159] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:24.198533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:24.256299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:24.299565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a5c59-7af4-4721-bb30-141e13573737 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:24.334993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5861e-ee3e-41bc-bb21-40b11ab4df0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:24.335879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5861e-ee3e-41bc-bb21-40b11ab4df0f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:24.336163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5861e-ee3e-41bc-bb21-40b11ab4df0f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:24.336426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5861e-ee3e-41bc-bb21-40b11ab4df0f None admin] PATH_INFO: `/v3/projects/6538286cb7244733a0bf7a6f0df4534e` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:24.337688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5861e-ee3e-41bc-bb21-40b11ab4df0f None admin] RBAC: Authorizing `identity:get_project(project_id=6538286cb7244733a0bf7a6f0df4534e)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:24.339129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5861e-ee3e-41bc-bb21-40b11ab4df0f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:24.340858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 582/1160] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:24 2022] GET /identity/v3/projects/6538286cb7244733a0bf7a6f0df4534e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:24.347415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:24.461015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc80be-8543-4c10-a8de-ac6c5b5d2e94 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:24.497300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:24.497978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:24.498382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:24.498658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:24.500457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=6538286cb7244733a0bf7a6f0df4534e, user.id=278921937ccc48d185a6623ceefb55f5) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:24.500787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:24.502241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fec00-bf35-49fe-b06e-4b34f6b09ac3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:24.508345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 579/1161] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:05:24 2022] GET /identity/v3/role_assignments?user.id=278921937ccc48d185a6623ceefb55f5&scope.project.id=6538286cb7244733a0bf7a6f0df4534e&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:26.722506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abbb1a-3d5e-46ea-9361-3690caa0f1e1 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:26.723095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abbb1a-3d5e-46ea-9361-3690caa0f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:26.723435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abbb1a-3d5e-46ea-9361-3690caa0f1e1 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:26.724915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 583/1162] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:26.731879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:26.732342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:26.732465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:26.754697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:26.755912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:26.823791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:26.835911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 580/1163] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:26.872233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abbb1a-3d5e-46ea-9361-3690caa0f1e1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:26.987067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abbb1a-3d5e-46ea-9361-3690caa0f1e1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:27.015941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:27.027417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:27.028069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:27.028349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:27.028622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:27.103502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:27.104980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:27.209571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 584/1164] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:27.219309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:27.329864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3128-a6d3-47c9-bec3-93bbf1f7845b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:27.371791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:27.372601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:27.372885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:27.373160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:27.380145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:27.381604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d861ab30-d325-4708-98ef-fdb63b69343e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:27.395853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:27.398618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:05:27.400533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 581/1165] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:05:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:27.406119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:27.436939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:27.517954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb05ce0-c023-44ff-8cf0-4a8a7eda3cca None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:27.556979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:27.557627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:27.557903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:27.558174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:27.558892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:27.559240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:27.560616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29ed4f-5fd6-4481-8a54-704b3a73f1c0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:27.568044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 585/1166] 10.222.0.45 () {56 vars in 1115 bytes} [Wed May 25 16:05:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:29.750275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b960e8-d0e2-41b9-88fe-2f956990a509 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:29.751208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b960e8-d0e2-41b9-88fe-2f956990a509 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:29.751353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b960e8-d0e2-41b9-88fe-2f956990a509 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:29.753480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 582/1167] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:29.760062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c745b2-5d48-47dc-8a0c-55a9e3abef21 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:29.760803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c745b2-5d48-47dc-8a0c-55a9e3abef21 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:29.760955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c745b2-5d48-47dc-8a0c-55a9e3abef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:29.783352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b9c745b2-5d48-47dc-8a0c-55a9e3abef21 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:29.784569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b9c745b2-5d48-47dc-8a0c-55a9e3abef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:29.853347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 586/1168] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:29.877627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b960e8-d0e2-41b9-88fe-2f956990a509 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:29.941099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:29.997814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b960e8-d0e2-41b9-88fe-2f956990a509 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:30.034814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dce5dd-a1c6-4869-8981-aca01b4d87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:30.035500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce5dd-a1c6-4869-8981-aca01b4d87fa None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:30.035783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce5dd-a1c6-4869-8981-aca01b4d87fa None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:30.036058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce5dd-a1c6-4869-8981-aca01b4d87fa None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:30.036851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce5dd-a1c6-4869-8981-aca01b4d87fa None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:30.038234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce5dd-a1c6-4869-8981-aca01b4d87fa None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:30.055067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 583/1169] 10.222.0.45 () {60 vars in 1138 bytes} [Wed May 25 16:05:29 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:05:32.279832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954730ee-2c5d-42a9-8a2e-9f17e7f449dc None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:32.280426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954730ee-2c5d-42a9-8a2e-9f17e7f449dc None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:32.280426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954730ee-2c5d-42a9-8a2e-9f17e7f449dc None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:32.281821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 587/1170] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:32.288244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:32.288945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:32.289077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:32.309579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:32.310748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:32.382724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 584/1171] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:32.408029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954730ee-2c5d-42a9-8a2e-9f17e7f449dc None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:32.432641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:32.520597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954730ee-2c5d-42a9-8a2e-9f17e7f449dc None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:32.553939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803511ff-1831-4137-aac2-8334de50bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:32.554850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803511ff-1831-4137-aac2-8334de50bf04 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:32.555136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803511ff-1831-4137-aac2-8334de50bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:32.555442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803511ff-1831-4137-aac2-8334de50bf04 None admin] PATH_INFO: `/v3/domains/57d049d884954e67a2142ab6cbf622a6` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:32.566160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803511ff-1831-4137-aac2-8334de50bf04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=57d049d884954e67a2142ab6cbf622a6)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:32.567666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803511ff-1831-4137-aac2-8334de50bf04 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:32.569298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 588/1172] 10.222.0.45 () {56 vars in 1183 bytes} [Wed May 25 16:05:32 2022] GET /identity/v3/domains/57d049d884954e67a2142ab6cbf622a6 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:32.576394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:32.628782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:32.690461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059583a-87ba-4e71-ba5a-46be7629f6dc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:32.729144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483979-4f54-46c6-9098-6ac524c12db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:32.729807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483979-4f54-46c6-9098-6ac524c12db9 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:32.730086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483979-4f54-46c6-9098-6ac524c12db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:32.730360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483979-4f54-46c6-9098-6ac524c12db9 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:32.731082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2483979-4f54-46c6-9098-6ac524c12db9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:32.732602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2483979-4f54-46c6-9098-6ac524c12db9 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:32.761827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 585/1173] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:05:32 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:05:34.974119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15034d5c-c989-44ff-8b05-44aa95be824f None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:34.974726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15034d5c-c989-44ff-8b05-44aa95be824f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:34.974726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15034d5c-c989-44ff-8b05-44aa95be824f None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:34.976059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 589/1174] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:34.982803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:34.983643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:34.983793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:35.005598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:35.006776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:35.077330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 586/1175] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:35.102329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15034d5c-c989-44ff-8b05-44aa95be824f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:35.190193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:35.219652 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15034d5c-c989-44ff-8b05-44aa95be824f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:35.257234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e8ee0-4162-461f-8909-2f45e9581a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:35.258019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e8ee0-4162-461f-8909-2f45e9581a6b None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:35.258297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e8ee0-4162-461f-8909-2f45e9581a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:35.258560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e8ee0-4162-461f-8909-2f45e9581a6b None admin] PATH_INFO: `/v3/domains/57d049d884954e67a2142ab6cbf622a6` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:35.260072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e8ee0-4162-461f-8909-2f45e9581a6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=57d049d884954e67a2142ab6cbf622a6)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:35.261901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e8ee0-4162-461f-8909-2f45e9581a6b None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:35.265030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 590/1176] 10.222.0.45 () {56 vars in 1183 bytes} [Wed May 25 16:05:35 2022] GET /identity/v3/domains/57d049d884954e67a2142ab6cbf622a6 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:35.271633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:35.302164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:35.391936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ee9fc-cf96-416a-a229-55c84e21a100 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:35.428761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266288ca-dc02-4077-ba2a-68bb3261ec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:35.429418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266288ca-dc02-4077-ba2a-68bb3261ec70 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:35.429694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266288ca-dc02-4077-ba2a-68bb3261ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:35.429960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266288ca-dc02-4077-ba2a-68bb3261ec70 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:35.430659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266288ca-dc02-4077-ba2a-68bb3261ec70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:35.432125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266288ca-dc02-4077-ba2a-68bb3261ec70 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:35.454064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 587/1177] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:05:35 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:05:37.670978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b141a-e5d5-4cff-87bd-5043ca72efb1 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:37.671884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b141a-e5d5-4cff-87bd-5043ca72efb1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:37.671884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b141a-e5d5-4cff-87bd-5043ca72efb1 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:37.674046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 591/1178] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:37.683049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:37.683516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:37.683643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:37.707022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:37.708309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:37.781605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 588/1179] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:37.810759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b141a-e5d5-4cff-87bd-5043ca72efb1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:37.926563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b141a-e5d5-4cff-87bd-5043ca72efb1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:37.961121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:37.961904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:37.962184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:37.962459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:37.980743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:05:37.993408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:37.994477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:05:37.995430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 592/1180] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:38.001639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:38.017019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:38.113590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd1b63-12a2-4c86-88de-33cb1de337aa None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:38.149738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:38.150393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:38.150673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:38.150945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:38.151767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:38.152073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:38.153455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:38.161630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 589/1181] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:05:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:05:38.170915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:38.182904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:38.275786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be06381-e9fb-43e7-9ff7-70dd2d181611 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:38.313411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:38.314283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:38.314566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:38.314841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] PATH_INFO: `/v3/users/8c61a148912a4f03b97ac3c85b08cfa0` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:38.331046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] RBAC: Authorizing `identity:get_user(user_id=8c61a148912a4f03b97ac3c85b08cfa0)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:38.332538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:38.334237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 593/1182] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:38 2022] GET /identity/v3/users/8c61a148912a4f03b97ac3c85b08cfa0 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:38.347323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:38.430225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:38.462462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288defcd-8893-4548-9ef3-17f4be727f7c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:38.495772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:38.496407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:38.496691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:38.496964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:38.579116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:38.580616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:38.656915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:38.694073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 590/1183] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:38.700388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:38.772962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:38.825743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8609-35ac-4eb2-8b9e-f4d98190cec3 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:38.872268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490026d3-31e3-4929-9334-0feecc9b63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:38.873149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490026d3-31e3-4929-9334-0feecc9b63e0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:38.873433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490026d3-31e3-4929-9334-0feecc9b63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:38.873707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490026d3-31e3-4929-9334-0feecc9b63e0 None admin] PATH_INFO: `/v3/projects/65156ead0e2141c89177a4f0f8b39422` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:38.874927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490026d3-31e3-4929-9334-0feecc9b63e0 None admin] RBAC: Authorizing `identity:get_project(project_id=65156ead0e2141c89177a4f0f8b39422)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:38.876415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490026d3-31e3-4929-9334-0feecc9b63e0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:38.878132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 594/1184] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:38 2022] GET /identity/v3/projects/65156ead0e2141c89177a4f0f8b39422 => generated 361 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:38.885302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:38.990984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d001-2276-4bc4-8276-3c2c2a7a6430 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:39.030143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:39.030800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:39.031075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:39.031375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:39.032197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=65156ead0e2141c89177a4f0f8b39422, user.id=8c61a148912a4f03b97ac3c85b08cfa0) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:39.032500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:39.033941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5721a8c-4748-4bb9-b504-edb68e463596 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:39.040272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 591/1185] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:05:38 2022] GET /identity/v3/role_assignments?user.id=8c61a148912a4f03b97ac3c85b08cfa0&scope.project.id=65156ead0e2141c89177a4f0f8b39422&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:41.211661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823853e-7fa6-491d-8b03-9e8e6ba53ec0 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:41.212516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823853e-7fa6-491d-8b03-9e8e6ba53ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:41.212516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823853e-7fa6-491d-8b03-9e8e6ba53ec0 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:41.214532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 595/1186] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:41.220996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:41.221433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:41.221542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:41.247856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:41.249048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:41.278996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:41.323765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 592/1187] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:41.346387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823853e-7fa6-491d-8b03-9e8e6ba53ec0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:41.458035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823853e-7fa6-491d-8b03-9e8e6ba53ec0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:41.495710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:41.496493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:41.496775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:41.497049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:41.499204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:41.509484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:05:41.517147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:41.518221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:05:41.519111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 596/1188] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:41.527055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:41.644229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f456d-8dc1-4ce0-b5fc-6245f437f716 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:41.681297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:41.681962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:41.682243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:41.682520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:41.683278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:41.683608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:41.684990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:41.693383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 593/1189] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:41.699623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:41.800162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00341b99-2b5c-4099-80b2-20c9573993cd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:41.838109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:41.838987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:41.839304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:41.839585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] PATH_INFO: `/v3/users/8c61a148912a4f03b97ac3c85b08cfa0` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:41.840869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=8c61a148912a4f03b97ac3c85b08cfa0)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:41.842334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:41.843980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 597/1190] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:41 2022] GET /identity/v3/users/8c61a148912a4f03b97ac3c85b08cfa0 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:41.849804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:41.881151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:41.967543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b3ecd-5cb9-4987-bb05-e01a18c28518 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:42.012291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bbd42-6042-4e61-9e6c-bb4638dce022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:42.013163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bbd42-6042-4e61-9e6c-bb4638dce022 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:42.013444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bbd42-6042-4e61-9e6c-bb4638dce022 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:42.013686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bbd42-6042-4e61-9e6c-bb4638dce022 None admin] PATH_INFO: `/v3/projects/65156ead0e2141c89177a4f0f8b39422` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:42.015565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bbd42-6042-4e61-9e6c-bb4638dce022 None admin] RBAC: Authorizing `identity:get_project(project_id=65156ead0e2141c89177a4f0f8b39422)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:42.017013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bbd42-6042-4e61-9e6c-bb4638dce022 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:42.018693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 594/1191] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:41 2022] GET /identity/v3/projects/65156ead0e2141c89177a4f0f8b39422 => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:42.024780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:42.089320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:42.128911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230699d-f30f-44ce-9899-1779892b4fe7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:42.163566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc6143-dc05-4c9b-83f4-9618d413adb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:42.164444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc6143-dc05-4c9b-83f4-9618d413adb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:42.164715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc6143-dc05-4c9b-83f4-9618d413adb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:42.164990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc6143-dc05-4c9b-83f4-9618d413adb2 None admin] PATH_INFO: `/v3/projects/65156ead0e2141c89177a4f0f8b39422/users/8c61a148912a4f03b97ac3c85b08cfa0/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:42.167577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc6143-dc05-4c9b-83f4-9618d413adb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=65156ead0e2141c89177a4f0f8b39422, user_id=8c61a148912a4f03b97ac3c85b08cfa0, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:42.169029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc6143-dc05-4c9b-83f4-9618d413adb2 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:42.185135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 598/1192] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:05:42 2022] PUT /identity/v3/projects/65156ead0e2141c89177a4f0f8b39422/users/8c61a148912a4f03b97ac3c85b08cfa0/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:05:44.347097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a5368-ae19-4034-bb79-8040134875cb None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:44.347972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a5368-ae19-4034-bb79-8040134875cb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:44.347972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a5368-ae19-4034-bb79-8040134875cb None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:44.350057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 595/1193] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:05:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:05:44.358841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:44.359299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:44.359463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:44.383543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:05:44.384727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:05:44.457221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 599/1194] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:05:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:05:44.483861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a5368-ae19-4034-bb79-8040134875cb None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:44.589759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:44.598631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a5368-ae19-4034-bb79-8040134875cb None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:44.633954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:44.634740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:44.635018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:44.635318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:44.646062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:05:44.653727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:05:44.654703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:05:44.655639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 596/1195] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:05:44.664315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:44.719532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:44.769983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc7a88-adef-414e-8016-895f47aeb1dd None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:44.805751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:44.806409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:44.806691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:44.806961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:44.807718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:44.808081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:44.809463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:44.817649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 600/1196] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:44.823871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:44.935429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc2e43-229d-498e-ad96-c0392efd3d46 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:44.972499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:44.973382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:44.973663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:44.973939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] PATH_INFO: `/v3/users/8c61a148912a4f03b97ac3c85b08cfa0` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:44.975277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] RBAC: Authorizing `identity:get_user(user_id=8c61a148912a4f03b97ac3c85b08cfa0)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:44.976740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:44.978387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 597/1197] 10.222.0.45 () {56 vars in 1177 bytes} [Wed May 25 16:05:44 2022] GET /identity/v3/users/8c61a148912a4f03b97ac3c85b08cfa0 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:44.984579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:45.097126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b271e8-fb29-4872-9dbc-9b8fdcbe32ea None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:45.110952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:45.133288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:45.133927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:45.134200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:45.134469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:45.207350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:45.208754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:45.311338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 601/1198] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:05:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:05:45.321014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:45.357310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:45.438637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eff8b3-9980-4d2d-aeeb-161cedfcc00d None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:45.473653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed8df7-1ca3-46d6-8472-e32f550b8f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:45.474446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8df7-1ca3-46d6-8472-e32f550b8f60 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:45.474728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8df7-1ca3-46d6-8472-e32f550b8f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:45.475004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed8df7-1ca3-46d6-8472-e32f550b8f60 None admin] PATH_INFO: `/v3/projects/65156ead0e2141c89177a4f0f8b39422` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:45.476335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8df7-1ca3-46d6-8472-e32f550b8f60 None admin] RBAC: Authorizing `identity:get_project(project_id=65156ead0e2141c89177a4f0f8b39422)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:45.477788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed8df7-1ca3-46d6-8472-e32f550b8f60 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:45.479520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 598/1199] 10.222.0.45 () {56 vars in 1186 bytes} [Wed May 25 16:05:45 2022] GET /identity/v3/projects/65156ead0e2141c89177a4f0f8b39422 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:45.486626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:05:45.510379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:45.597141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f334ae-1a57-4c88-b3da-000c975c17c7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:05:45.632841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:05:45.633485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:05:45.633763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:05:45.634037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:05:45.634862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=65156ead0e2141c89177a4f0f8b39422, user.id=8c61a148912a4f03b97ac3c85b08cfa0) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:05:45.635196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:05:45.636651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad201909-d789-4d7c-b78e-ffc75bc037bf None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:05:45.642662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 602/1200] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:05:45 2022] GET /identity/v3/role_assignments?user.id=8c61a148912a4f03b97ac3c85b08cfa0&scope.project.id=65156ead0e2141c89177a4f0f8b39422&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:05:55.468624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=55 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:05:55.639970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=61 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:46.033741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29eee-0c52-4c79-97b2-de6b72e0899b None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.034356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29eee-0c52-4c79-97b2-de6b72e0899b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.034356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc29eee-0c52-4c79-97b2-de6b72e0899b None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.036343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 599/1201] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:06:46.043510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.044128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.044128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.065786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:06:46.065786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:46.172277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 603/1202] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:06:46.199016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc29eee-0c52-4c79-97b2-de6b72e0899b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:46.326351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc29eee-0c52-4c79-97b2-de6b72e0899b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:46.370065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:46.370959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.371329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.371655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.386984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:46.388725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:06:46.410575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:46.411930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:46.413220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:06:46.413220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:06:46.413220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:46.413220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:06:46.415402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 600/1203] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:46.422402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:46.553915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee2444-d7a3-46d6-a7f4-93e97f15d9b0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:46.592312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:46.601087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:46.601870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.602157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.602437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.603319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:46.603619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:46.605206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005cc956-638f-46be-b620-ec6f167341d4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:46.619019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 604/1204] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:46.628448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:46.691991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:46.750650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a560fa-31eb-45c6-b487-cf695766950c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:46.789738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38605787-cb3d-435f-965d-9633b42e8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:46.791349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605787-cb3d-435f-965d-9633b42e8684 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.792206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605787-cb3d-435f-965d-9633b42e8684 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.792649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605787-cb3d-435f-965d-9633b42e8684 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.793530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38605787-cb3d-435f-965d-9633b42e8684 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:46.795143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38605787-cb3d-435f-965d-9633b42e8684 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:46.819381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 601/1205] 10.222.0.45 () {60 vars in 1132 bytes} [Wed May 25 16:06:46 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:06:49.251838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7887-d489-49b1-9b01-577de447db15 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:49.252396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7887-d489-49b1-9b01-577de447db15 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:49.252396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead7887-d489-49b1-9b01-577de447db15 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:49.254036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 605/1206] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:06:49.260128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:49.260625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:49.260625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:49.278786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:06:49.280048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:49.357284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 602/1207] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:06:49.381728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7887-d489-49b1-9b01-577de447db15 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:49.506400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead7887-d489-49b1-9b01-577de447db15 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:49.549316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:49.550151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:49.550580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:49.550855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:49.564689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:06:49.573320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:49.574379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:49.575282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 606/1208] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:49.581281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:49.634836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:49.711649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9fb77-6429-4171-ab39-27b2f71e4a56 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:49.757514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:49.758304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:49.758659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:49.758999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:49.760307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:49.763410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:49.763410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:49.778161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 603/1209] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:06:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:06:49.779236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:49.851915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:49.917270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2cf5e-dfe8-4ad4-97e3-bada07b3cea9 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:49.964573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:49.965485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:49.965836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:49.966114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:49.979539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:49.981204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:06:50.003612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:50.004884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:50.006109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:06:50.006109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:06:50.006109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:50.006109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:50.007372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 607/1210] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:06:50.013375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:50.138450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a92fe-029e-440b-865e-cd76baea29d1 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:50.140250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:50.180339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:50.181060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:50.181394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:50.181717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:50.182637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:50.182979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:50.184589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:50.203894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 604/1211] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:50.205437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:50.313765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15116da-c632-42e4-9bca-2d36440b8750 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:50.315394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:50.351053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:50.352351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:50.352351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:50.352559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:50.360387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:50.361860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:06:50.376880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:50.378015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:50.378979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 608/1212] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:50.384099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:50.496750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e313f-2a57-42a5-8576-db684bb8d14b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:50.532546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:50.533231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:50.533512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:50.533798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:50.534608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:50.534914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:50.536517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:50.558869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 605/1213] 10.222.0.45 () {56 vars in 1143 bytes} [Wed May 25 16:06:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:50.565038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:50.698815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5090c3c-9398-46b9-821e-f2bca1e8b3ac None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:50.738798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:50.739548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:50.739825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:50.740173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:50.774941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:50.821789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:50.823471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:50.938767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 609/1214] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:06:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:06:50.944842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:50.965529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:51.061123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8d67-0ea1-415d-aa54-3b0d4314a6fc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:51.109010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:51.109942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:51.110224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:51.110499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:51.121994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:51.123651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:06:51.143958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:51.144941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:51.145912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:06:51.145912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:06:51.145912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:51.145912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:06:51.145912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 606/1215] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:06:51.151068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:51.225309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:51.268298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0a0a-f2a0-4b1d-96b7-9fd8c4653f7e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:51.313618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:51.314547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:51.315222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:51.317346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:51.317346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:51.317346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:51.318343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:51.333004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 610/1216] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:06:51.340396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:51.427514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:51.467070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decb5e3-6e1f-4fc2-9682-af156faa591e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:51.504363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:51.506479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:51.506479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:51.506479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:51.512981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:51.514498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:06:51.528818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:51.529961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:06:51.531000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 607/1217] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:51.536177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:51.656014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739d027-106b-4b19-bc49-9207a94cbbce None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:51.680926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:51.694928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:51.695760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:51.696123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:51.696507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:51.697382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:51.697797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:51.699549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705f120-af36-4e79-aceb-b63f3ca183e4 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:51.713301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 611/1218] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:51.719551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:51.838064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f2ae0-1c10-4ebe-99ce-3d11dec01e06 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:51.870989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:51.877445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:51.878107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:51.878386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:51.878657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:51.879519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=59e10be40282478faf3da72169dee4a1) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:51.879830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:51.881306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d693310-79e2-40a4-89d3-9a36adb3e73c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:51.886804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 608/1219] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:06:51 2022] GET /identity/v3/role_assignments?user.id=59e10be40282478faf3da72169dee4a1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:54.162500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b73ed-be27-4846-a8f8-895dbbdd2508 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:54.163083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b73ed-be27-4846-a8f8-895dbbdd2508 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:54.163083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b73ed-be27-4846-a8f8-895dbbdd2508 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:54.165221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 612/1220] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:06:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:06:54.174370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:54.174986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:54.175101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:54.196095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:06:54.197394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:54.279787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 609/1221] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:06:54.310718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b73ed-be27-4846-a8f8-895dbbdd2508 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:54.420251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b73ed-be27-4846-a8f8-895dbbdd2508 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:54.457193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:54.458091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:54.458385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:54.458718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:54.470878 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:06:54.478738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:54.479861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:54.483334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 613/1222] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:06:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:54.487179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:54.602391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a1b3-a9a4-49be-bd77-7b74bfbe0785 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:54.628739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:54.645317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:54.646128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:54.646412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:54.646808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:54.647765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] RBAC: Adding query filter params (name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:54.648145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:54.649761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:54.659964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 610/1223] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:06:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:54.666145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:54.717607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:54.780711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fbb380-f19b-4bb1-8d04-ab00e2c9c523 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:54.819442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:54.820379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:54.820729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:54.821021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:54.832979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:54.834747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:06:54.854349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:54.855560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:54.856704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:06:54.856704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:06:54.856704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:54.856704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:54.856704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 614/1224] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:54.861974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:54.976828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6dff7-c29b-4b7f-bcf8-eb716aefe714 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:55.018765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:55.019473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:55.019754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:55.020023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:55.020738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:55.021167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:55.023016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:55.036681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 611/1225] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:55.044879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:55.155848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:55.163977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb6522-ac27-46aa-9269-e097598d0208 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:55.201771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:55.202707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:55.202991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:55.203264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:55.212984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:55.215199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:06:55.237540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:55.238726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:55.239795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 615/1226] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:55.245158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:55.303003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:55.374762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ba17-29c8-4080-bb64-71fde735d0ea None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:55.420787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:55.421537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:55.421861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:55.422380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:55.423420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:55.423755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:55.425231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:55.444776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 612/1227] 10.222.0.45 () {56 vars in 1143 bytes} [Wed May 25 16:06:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:06:55.450926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:55.558896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b17cbf-09bf-4e36-bd42-b1f238a3c79c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:55.602771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:55.603615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:55.603896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:55.604168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:55.617951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:55.619677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:06:55.644635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:55.645772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:55.646739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:06:55.646739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:06:55.646739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:55.646739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:55.646739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 616/1228] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:55.651878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:55.768042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9baf78-bd73-45c8-8be6-998826e235be None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:55.770866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:55.808844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:55.809628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:55.809815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:55.810085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:55.810883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:55.811129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:55.812580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:55.825243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 613/1229] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:55.831832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:55.842642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:55.942958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739e23f-84a8-41af-ae8b-6cf2869a5f75 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:55.980716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:55.981659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:55.981962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:55.982296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:55.991140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:55.993374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:06:56.012844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:56.013942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:06:56.014975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 617/1230] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:56.020643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:56.136586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb2f3-db32-4bae-9176-f36cacb97bc8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:56.174282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:56.174960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:56.175327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:56.175662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:56.176527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:56.176941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:56.178587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8799c3-8796-423e-8b69-dc152615bad3 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:56.191571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 614/1231] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:56.197875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:56.269619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:56.307668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e675289-cbb9-42ee-b36b-f1a327959d44 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:56.346894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b47c04-8229-4f86-8c67-43a7f7e7c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:56.348085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b47c04-8229-4f86-8c67-43a7f7e7c0d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:56.348496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b47c04-8229-4f86-8c67-43a7f7e7c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:56.348784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b47c04-8229-4f86-8c67-43a7f7e7c0d0 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/59e10be40282478faf3da72169dee4a1/roles/bf4f6bdee78e4247b342ad51012d03fc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:56.364511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b47c04-8229-4f86-8c67-43a7f7e7c0d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=59e10be40282478faf3da72169dee4a1, role_id=bf4f6bdee78e4247b342ad51012d03fc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:56.366308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b47c04-8229-4f86-8c67-43a7f7e7c0d0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:56.381380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 618/1232] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:06:56 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/59e10be40282478faf3da72169dee4a1/roles/bf4f6bdee78e4247b342ad51012d03fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:06:58.572844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226613-6149-443c-add5-e45d501ebe56 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:58.573454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226613-6149-443c-add5-e45d501ebe56 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:58.573454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226613-6149-443c-add5-e45d501ebe56 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:58.574766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 615/1233] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:06:58.580358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:58.580860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:58.580979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:58.599091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:06:58.600485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:58.677932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 619/1234] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:06:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:06:58.703098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226613-6149-443c-add5-e45d501ebe56 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:58.732882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:58.827654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226613-6149-443c-add5-e45d501ebe56 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:58.872937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:58.873930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:58.874303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:58.874675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] PATH_INFO: `/v3/roles/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:58.885870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:06:58.893616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:58.894794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:06:58.896046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 616/1235] 10.222.0.45 () {56 vars in 1102 bytes} [Wed May 25 16:06:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:58.901439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:58.953955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:59.017192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189294-3c70-46f1-bf40-f24420eafde0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:59.058687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:59.059526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:59.059857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:59.060190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:59.061037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] RBAC: Adding query filter params (name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:59.061419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:59.063022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:59.072442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 620/1236] 10.222.0.45 () {56 vars in 1103 bytes} [Wed May 25 16:06:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:59.078382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:59.174182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:59.191803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefdfc-aa57-4134-a001-a922c30328da None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:59.232809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:59.233625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:59.233908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:59.234179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:59.246638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:59.248153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:06:59.266396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:59.267637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:59.268905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:06:59.268905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:06:59.268905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:06:59.268905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:06:59.268905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 617/1237] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:06:59.274086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:59.382711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b4e3d-f3b3-43a8-8320-35fb3505eedf None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:59.392533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:59.423337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:59.424018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:59.424271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:59.424545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:59.425277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:59.425575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:59.426959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:59.442060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 621/1238] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:06:59.448002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:59.564393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354268-c534-48e4-8e49-75f241eadc4a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:59.603850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:59.604663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:59.604939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:59.605203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:59.608317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:59.614467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:59.616384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:06:59.633505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:06:59.634628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:06:59.635646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 618/1239] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:06:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:06:59.641303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:59.752971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78612e-1999-4cb1-9ae9-b45c89776642 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:59.798836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:59.799781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:59.800146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:59.800425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:59.801435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:06:59.801907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:59.803744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:59.827300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 622/1240] 10.222.0.45 () {56 vars in 1143 bytes} [Wed May 25 16:06:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:06:59.835052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:59.955317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9d30a-c800-4b40-bffb-50d9b9d074cc None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:59.994583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:59.995307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:59.995585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:59.995852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:00.066263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:00.077340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:00.078957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:00.191813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 619/1241] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:06:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:07:00.198347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:00.230818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:00.307044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775542b-91a8-42e8-a9f1-a85f86fcc763 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:00.344746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:00.345555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:00.345872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:00.346196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:00.356953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:00.358448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:00.377163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:00.378153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:00.384937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:00.384937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:00.384937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:00.384937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:00.384937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 623/1242] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:00.387625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:00.509468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:00.516732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46924ad-7d7d-4e6f-8a5c-1aadb9efe137 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:00.552472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:00.553527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:00.553824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:00.554103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:00.554868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:00.555204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:00.556705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:00.568937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 620/1243] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:07:00.575643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:00.664450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:00.689177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419834-6a19-4cc9-9f07-36db031678dd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:00.728807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:00.729725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:00.730110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:00.730484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:00.740844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:00.742851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:07:00.759125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:00.760250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:00.761317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 624/1244] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:00.766627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:00.895938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e4831-9ed7-44a7-a750-fa432ae2ef3a None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:00.931237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:00.931911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:00.932233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:00.932561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:00.933394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:00.933708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:00.935229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287c38d-fcbe-4e10-9c96-31f1a6ebc0ce None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:00.948101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 621/1245] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:00.954783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:01.062617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc07c4-6fdc-415f-987d-b0dcdf64bad0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:01.103913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:01.104669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:01.104982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:01.105286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:01.106322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] RBAC: Adding query filter params (role.id=bf4f6bdee78e4247b342ad51012d03fc, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=59e10be40282478faf3da72169dee4a1) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:01.106689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:01.108389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10332afb-4a99-4919-98dd-51c08ca9a03f None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:01.115631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 625/1246] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:07:00 2022] GET /identity/v3/role_assignments?user.id=59e10be40282478faf3da72169dee4a1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=bf4f6bdee78e4247b342ad51012d03fc => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:03.524269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df5c7-12f4-44ac-b792-a925f66b6a20 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:03.524813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df5c7-12f4-44ac-b792-a925f66b6a20 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:03.524813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142df5c7-12f4-44ac-b792-a925f66b6a20 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:03.526255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 622/1247] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:03.533712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:03.533712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:03.533712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:03.537922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:03.555252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:03.556775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:03.640927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 626/1248] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:03.669465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df5c7-12f4-44ac-b792-a925f66b6a20 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:03.691268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:03.788080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142df5c7-12f4-44ac-b792-a925f66b6a20 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:03.832081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:03.832971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:03.833227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:03.833519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:03.846477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:07:03.855055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:03.856394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:03.857390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 623/1249] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:03.863168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:03.979272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9f1e4-cb55-4791-9a4e-e7d16e9b8d56 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:04.014288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:04.020286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:04.020863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:04.021362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:04.021825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:04.022580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:04.022887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:04.024335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:04.033372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 627/1250] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:04.040000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:04.130527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:04.160998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0db684-98e5-4620-ab94-214d4cf657cf None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:04.201489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:04.202522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:04.202822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:04.203170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:04.216033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:04.218039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:04.237627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:04.238835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:04.240040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:04.240040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:04.240040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:04.240040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:04.240040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 624/1251] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:04.245642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:04.350191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82357da-c296-4ca6-9bec-bb45d427bedd None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:04.391389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:04.392058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:04.392339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:04.392613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:04.393327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:04.393628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:04.395015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:04.407277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 628/1252] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:04.414401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:04.531578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe7af0-013d-4d1c-9ad5-9768b359c63e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:04.563190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:04.572292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:04.573100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:04.573374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:04.573640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:04.585872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:04.587590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:07:04.606131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:04.607235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:07:04.608427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:04.612849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 625/1253] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:04.614349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:04.686260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:04.739426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be9d64-5055-4699-97b2-26a44d6335c7 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:04.784192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:04.786062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:04.786559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:04.787048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:04.788139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:04.788450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:04.790099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:04.810900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 629/1254] 10.222.0.45 () {56 vars in 1143 bytes} [Wed May 25 16:07:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:04.818602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:04.933337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bb13b-6031-43d4-b989-32fa9111dcce None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:04.971263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:04.971928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:04.972207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:04.972476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:05.036537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:05.053356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:05.055491 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:05.168096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 626/1255] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:07:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 16:07:05.175819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:05.281851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8524-dfd6-4147-a3ca-c68b0068ed1e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:05.295870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:05.319180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:05.319990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:05.320280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:05.320547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:05.334175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:05.334470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:05.352390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:05.353372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:05.354285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:05.354285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:05.354285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:05.354285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:05.354285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 630/1256] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:07:05.359527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:05.463861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:05.476746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2154f-9540-4436-aa79-afecd56f9887 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:05.514420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:05.515202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:05.515530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:05.515803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:05.516532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:05.516838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:05.518366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:05.531689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 627/1257] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:05.538112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:05.678209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a249c69-78c7-497c-9a96-9d9975e410d1 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:05.719926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:05.720761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:05.721041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:05.721321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:05.729505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:05.731015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:07:05.746053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:05.747138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:05.753360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 631/1258] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:05.753867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:05.880157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cc400-0f23-486c-94ab-a2f98e433ace None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:05.920434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:05.921119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:05.921404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:05.921680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:05.922493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:05.922803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:05.924305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90354652-83de-4467-9036-7ac1fca60b71 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:05.937651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 628/1259] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:07:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:05.944110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:05.972764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:06.054789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb264f-7feb-4593-b40b-b3a3278ce823 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:06.096156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:06.096834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:06.097114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:06.097383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:06.098223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=59e10be40282478faf3da72169dee4a1) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:06.098531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:06.100152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23cf70-5f88-42df-b277-b2b5ba3fe6f5 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:06.106504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 632/1260] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:07:05 2022] GET /identity/v3/role_assignments?user.id=59e10be40282478faf3da72169dee4a1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:08.290429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18454-110d-4c9e-bbd6-bbc5a237d1d7 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:08.291333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18454-110d-4c9e-bbd6-bbc5a237d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:08.291333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc18454-110d-4c9e-bbd6-bbc5a237d1d7 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:08.293913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 629/1261] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:08.302946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:08.303408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:08.303526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:08.322019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:08.323142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:08.393986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 633/1262] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:08.417994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18454-110d-4c9e-bbd6-bbc5a237d1d7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:08.435432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:08.539450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc18454-110d-4c9e-bbd6-bbc5a237d1d7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:08.576682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:08.577424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:08.577700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:08.577974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:08.588991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:07:08.596540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:08.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:08.598385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 630/1263] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:07:08.604201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:08.623782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:08.705533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ed1973-f734-49e3-95d1-db2427988b10 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:08.741034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:08.741687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:08.741969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:08.742238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:08.742978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:08.743294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:08.744702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:08.753720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 634/1264] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:08.759974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:08.845403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:08.885179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e49b1-9676-4d97-8253-76e81ee868b5 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:08.920405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:08.921258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:08.921532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:08.921799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:08.933141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:08.934593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:08.952812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:08.953802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:08.960208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:08.960208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:08.960208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:08.960208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:08.960208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 631/1265] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 16:07:08.962345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:09.066553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:09.087458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f7d9f-de68-4c03-a26b-4f2a4cc8e2ac None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:09.122407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:09.123010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:09.123323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:09.123603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:09.124324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:09.124635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:09.126015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:09.137778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 635/1266] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:09.144483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:09.251786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f849c26a-5b65-4e8d-bb73-5743917f82d0 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:09.273049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:09.291199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:09.292369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:09.292652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:09.292925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:09.300756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:09.302208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:07:09.316532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:09.317605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:09.318940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 632/1267] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:09.323820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:09.441153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54654694-7016-4265-b8ef-1e0843663f62 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:09.474778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:09.475514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:09.475798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:09.476074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:09.476909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:09.477218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:09.478662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:09.487198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:09.502389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 636/1268] 10.222.0.45 () {56 vars in 1143 bytes} [Wed May 25 16:07:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:09.508447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:09.615945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703bbc7-4f56-43d7-84fb-6b728e88705e None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:09.651118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:09.651937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:09.652215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:09.652485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:09.664588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:09.666033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:09.685040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:09.686096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:09.687144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:09.687144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:09.687144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:09.687144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:09.687144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 633/1269] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:09.692354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:09.805894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28522c5d-4b76-42d3-8676-e5eb216dab79 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:09.849887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:09.850541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:09.850816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:09.851084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:09.851851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:09.852176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:09.853548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:09.866538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 637/1270] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:09.872542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:09.905716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:09.976766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790703c-9b62-4c0b-b8bf-4183c46381aa None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:10.014856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:10.015671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:10.015947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:10.016221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:10.023415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:10.024869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:07:10.040167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:10.041181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:10.042831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 634/1271] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:07:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:10.050831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:10.116532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:10.159171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880158e7-707b-479b-94fc-70ca6136b886 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:10.198060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:10.198714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:10.198990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:10.199286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:10.200048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:10.200361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:10.201796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e4207-c191-410e-a0d7-1700989af946 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:10.213868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 638/1272] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:07:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:10.222872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:10.323429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:10.332544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6de9b-baf6-4a21-a221-099f0cfa14f8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:10.370667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc94cf6-4ca3-4d00-89c8-ac64631300d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:10.371593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94cf6-4ca3-4d00-89c8-ac64631300d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:10.371872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94cf6-4ca3-4d00-89c8-ac64631300d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:10.372143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94cf6-4ca3-4d00-89c8-ac64631300d5 None admin] PATH_INFO: `/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/59e10be40282478faf3da72169dee4a1/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:10.374218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc94cf6-4ca3-4d00-89c8-ac64631300d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fff1cc8be2248d9b0edcc8256952f86, user_id=59e10be40282478faf3da72169dee4a1, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:10.375693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc94cf6-4ca3-4d00-89c8-ac64631300d5 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:10.392496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 635/1273] 10.222.0.45 () {58 vars in 1439 bytes} [Wed May 25 16:07:10 2022] PUT /identity/v3/projects/3fff1cc8be2248d9b0edcc8256952f86/users/59e10be40282478faf3da72169dee4a1/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:07:12.566075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6ea6-9e2d-42dc-961c-790e4ec26426 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:12.566910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6ea6-9e2d-42dc-961c-790e4ec26426 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:12.567016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c6ea6-9e2d-42dc-961c-790e4ec26426 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:12.569223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 639/1274] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:12.575618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:12.576312 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:12.576797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:12.598502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:12.599700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:12.670421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 636/1275] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:12.697164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6ea6-9e2d-42dc-961c-790e4ec26426 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:12.806629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c6ea6-9e2d-42dc-961c-790e4ec26426 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:12.827565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:12.850043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:12.851136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:12.851451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:12.851935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:12.864673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 16:07:12.872534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:12.873664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:12.874555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 640/1276] 10.222.0.45 () {56 vars in 1096 bytes} [Wed May 25 16:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:12.879895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:12.967958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:12.987576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe977e-7595-46c1-b485-be2c35f47472 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:13.022425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:13.023077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:13.023382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:13.023651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:13.024383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:13.024684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:13.026048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:13.034268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 637/1277] 10.222.0.45 () {56 vars in 1099 bytes} [Wed May 25 16:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:07:13.040521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:13.153222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06191bdf-aa50-4845-bb05-4ac25d21de84 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:13.188719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:13.189499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:13.189775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:13.190043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:13.201217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:13.202673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:13.219843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:13.220862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:13.222066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:13.222066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:13.222066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:13.222066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:13.222066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 641/1278] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:13.227431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:13.337232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10be4-7b31-44bb-a6b5-ffe5c566199f None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:13.373813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:13.374468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:13.374710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:13.375013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:13.375761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:13.376070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:13.377448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:13.389035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 638/1279] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:07:13.395492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:13.429847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:13.505536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73907ac-6d34-4b4a-ade2-e873a087e835 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:13.542969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56501-49af-49ef-8613-8f415432537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:13.543865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56501-49af-49ef-8613-8f415432537c None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:13.544165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56501-49af-49ef-8613-8f415432537c None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:13.544437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b56501-49af-49ef-8613-8f415432537c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:13.552845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b56501-49af-49ef-8613-8f415432537c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:13.554419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b56501-49af-49ef-8613-8f415432537c None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-81b56501-49af-49ef-8613-8f415432537c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 16:07:13.568860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:13.570287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:13.571296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 642/1280] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:13.578398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:13.584602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:13.694287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d137d3-7168-4302-8d50-bad85a2b99f8 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:13.732406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:13.733064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:13.733343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:13.733613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:13.734440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:13.734747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:13.736225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:13.756278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 639/1281] 10.222.0.45 () {56 vars in 1143 bytes} [Wed May 25 16:07:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:13.765601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56501-49af-49ef-8613-8f415432537c None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:13.880011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:13.891844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b56501-49af-49ef-8613-8f415432537c None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:13.927187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:13.927850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:13.928131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:13.928399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:14.000604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:14.001996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:14.093776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:14.105102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 643/1282] 10.222.0.45 () {58 vars in 1282 bytes} [Wed May 25 16:07:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 16:07:14.111193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:14.174794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:14.225977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99a7d4-d449-4f8f-af7c-39d523f01744 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:14.261744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:14.262470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:14.262750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:14.263105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:14.274279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:14.275794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 16:07:14.294564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:14.295636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:14.296689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 16:07:14.296689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 16:07:14.296689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 16:07:14.296689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:14.296689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 640/1283] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:14.302717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:14.410477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5cdae-98a0-44f8-97f1-939c01c0406e None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:14.446422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:14.447074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:14.447409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:14.447717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:14.448468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:14.448779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:14.450155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:14.461348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 644/1284] 10.222.0.45 () {56 vars in 1109 bytes} [Wed May 25 16:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:14.470616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:14.580362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f8c315-552a-400f-9564-d5aee1214f1b None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:14.594656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:14.617285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429572-0153-485b-8e55-972e9891156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:14.618075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429572-0153-485b-8e55-972e9891156c None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:14.618353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429572-0153-485b-8e55-972e9891156c None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:14.618624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429572-0153-485b-8e55-972e9891156c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:14.625522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429572-0153-485b-8e55-972e9891156c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:14.626979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429572-0153-485b-8e55-972e9891156c None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application [None req-06429572-0153-485b-8e55-972e9891156c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 16:07:14.640896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application with Lock( May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:14.641866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: ERROR keystone.server.flask.application May 25 16:07:14.642938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 641/1285] 10.222.0.45 () {56 vars in 1111 bytes} [Wed May 25 16:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:14.648822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:14.707414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:14.766671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678d348-355d-4147-81a9-1eaef1b044a0 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:14.801983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:14.802634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:14.802917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:14.803273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:14.804091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:14.804397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:14.805846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d9296-c71c-4237-b88c-c30f22f77d49 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:14.818408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 645/1286] 10.222.0.45 () {56 vars in 1148 bytes} [Wed May 25 16:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:14.825002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429572-0153-485b-8e55-972e9891156c None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:14.928004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429572-0153-485b-8e55-972e9891156c None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:14.963090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:14.963745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:14.964034 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:14.964278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:14.965133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] RBAC: Adding query filter params (role.id=3c10f6cfaef84131b248e3c006d4395f, scope.project.id=3fff1cc8be2248d9b0edcc8256952f86, user.id=59e10be40282478faf3da72169dee4a1) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:14.965444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:14.966887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2999b12-9f2e-401b-aa38-2604b07b1421 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:14.972877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 642/1287] 10.222.0.45 () {56 vars in 1374 bytes} [Wed May 25 16:07:14 2022] GET /identity/v3/role_assignments?user.id=59e10be40282478faf3da72169dee4a1&scope.project.id=3fff1cc8be2248d9b0edcc8256952f86&role.id=3c10f6cfaef84131b248e3c006d4395f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:17.177190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6916b-e0bf-44d8-8888-397a718854af None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:17.177780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6916b-e0bf-44d8-8888-397a718854af None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:17.177780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6916b-e0bf-44d8-8888-397a718854af None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:17.179185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 646/1288] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:17.188005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:17.188759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:17.188934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:17.214827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:17.216044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:17.248179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:17.291015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 643/1289] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:17.319595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6916b-e0bf-44d8-8888-397a718854af None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:17.432478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6916b-e0bf-44d8-8888-397a718854af None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:17.443133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:17.469077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:17.469867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:17.470150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:17.470402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:17.471060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:17.472492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:17.485041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:17.486212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:17.487074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 647/1290] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:07:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:17.495225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:17.610927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6601b85-2cfc-4f4a-8e34-0ad4a1fb9139 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:17.648802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:17.649475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:17.649759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:17.650027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:17.650732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:17.651038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:17.652467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0e9d9-bce2-45a0-a86b-b37790e9314e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:17.657668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 644/1291] 10.222.0.45 () {56 vars in 1116 bytes} [Wed May 25 16:07:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:17.664609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:17.776786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b791c-d2d3-449d-ac49-b0bb73682450 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:17.819907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:17.820624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:17.821028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:17.821321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] PATH_INFO: `/v3/services` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:17.822154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:17.822519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:17.824083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3300d5-94e9-4a9b-ad28-e92230d011f1 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:17.830078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 648/1292] 10.222.0.45 () {56 vars in 1116 bytes} [Wed May 25 16:07:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:20.010298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373727-648a-4275-80e6-aa8cb7001b74 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:20.011267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373727-648a-4275-80e6-aa8cb7001b74 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:20.011267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac373727-648a-4275-80e6-aa8cb7001b74 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:20.013397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 645/1293] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:20.018830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8d7c3-a562-4fa7-9e33-3849c5f62a29 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:20.019273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8d7c3-a562-4fa7-9e33-3849c5f62a29 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:20.019404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8d7c3-a562-4fa7-9e33-3849c5f62a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:20.036925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-d9e8d7c3-a562-4fa7-9e33-3849c5f62a29 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:20.038136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d9e8d7c3-a562-4fa7-9e33-3849c5f62a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:20.069258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:20.111377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 649/1294] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:20.134104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac373727-648a-4275-80e6-aa8cb7001b74 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:20.169568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:20.247547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac373727-648a-4275-80e6-aa8cb7001b74 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:20.287570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7ce22-80be-4843-bc52-951eff950465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:20.288660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ce22-80be-4843-bc52-951eff950465 None admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:20.289157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ce22-80be-4843-bc52-951eff950465 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:20.289697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7ce22-80be-4843-bc52-951eff950465 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:20.291010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ce22-80be-4843-bc52-951eff950465 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:20.293363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7ce22-80be-4843-bc52-951eff950465 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:20.311369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 646/1295] 10.222.0.45 () {60 vars in 1141 bytes} [Wed May 25 16:07:20 2022] POST /identity/v3/services => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:07:22.529547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0037-2935-40d8-8b03-c324854e220e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:22.530395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0037-2935-40d8-8b03-c324854e220e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:22.530395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e0037-2935-40d8-8b03-c324854e220e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:22.532710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 650/1296] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:22.539126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:22.539896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:22.540045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:22.563389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:22.564575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:22.650959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 647/1297] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:22.679137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0037-2935-40d8-8b03-c324854e220e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:22.787499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e0037-2935-40d8-8b03-c324854e220e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:22.831425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:22.832248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:22.832518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:22.832789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:22.833439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:22.835117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:22.849482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:22.850626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:22.851528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 651/1298] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:07:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:22.858137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:22.877930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:22.962940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a4d8f-8202-4296-be05-b83714ee09a8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:22.998107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:22.998760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:22.999085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:22.999394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:23.000095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:23.000403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:23.001782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:23.007399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 648/1299] 10.222.0.45 () {56 vars in 1116 bytes} [Wed May 25 16:07:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:23.014682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:23.050291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:23.124879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6802bc-68f5-4194-bdf4-f20497a80844 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:23.159415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:23.160062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:23.160341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:23.160611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:23.161388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] RBAC: Adding query filter params (interface=public, service_id=d6f8792c6b2244619f85677500924b48, region_id=RegionOne) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:23.161689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:23.163102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60856942-d9c6-4dca-8f65-e72e0a851eec None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:23.168638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 652/1300] 10.222.0.45 () {56 vars in 1251 bytes} [Wed May 25 16:07:23 2022] GET /identity/v3/endpoints?service_id=d6f8792c6b2244619f85677500924b48&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:23.175356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:23.263229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:23.284720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36e22c-02a3-4742-91f1-0b9ba9cc3575 None admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:23.334739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285ea5e-a404-4da8-837f-3f00ded2940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:23.335367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285ea5e-a404-4da8-837f-3f00ded2940e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:23.335650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285ea5e-a404-4da8-837f-3f00ded2940e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:23.335920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285ea5e-a404-4da8-837f-3f00ded2940e None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:23.336593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285ea5e-a404-4da8-837f-3f00ded2940e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:23.337966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285ea5e-a404-4da8-837f-3f00ded2940e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:23.345082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 649/1301] 10.222.0.45 () {56 vars in 1087 bytes} [Wed May 25 16:07:23 2022] GET /identity/v3/services => generated 2191 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:07:25.511527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa525b0-ad8d-4f71-995b-359597539fba None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:25.512143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa525b0-ad8d-4f71-995b-359597539fba None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:25.512143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa525b0-ad8d-4f71-995b-359597539fba None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:25.513373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 653/1302] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:07:25.519755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:25.520481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:25.520616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:25.539718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:07:25.540902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:07:25.620042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 650/1303] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:07:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 16:07:25.643462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa525b0-ad8d-4f71-995b-359597539fba None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:25.745428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:25.753177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa525b0-ad8d-4f71-995b-359597539fba None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:25.789265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:25.790059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:25.790346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:25.790614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:25.791292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:25.793042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:07:25.805786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:07:25.807052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:07:25.808365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 654/1304] 10.222.0.45 () {56 vars in 1117 bytes} [Wed May 25 16:07:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 16:07:25.814028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:25.902131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:25.931262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776b89c-9bae-49d4-9ce1-67a1bf936c1d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:25.968194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:25.968852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:25.969129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:25.969400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] PATH_INFO: `/v3/services` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:25.970097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:07:25.970402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:25.971818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d056e32-6764-468e-be1b-02c665bc0b0e None admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:25.977077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 651/1305] 10.222.0.45 () {56 vars in 1116 bytes} [Wed May 25 16:07:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:07:25.983786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:07:26.100832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875963-0a85-4112-8803-687c4967da99 None admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:07:26.137929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c14b-7009-49be-a7c7-014069775d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:07:26.138586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c14b-7009-49be-a7c7-014069775d70 None admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:07:26.138864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c14b-7009-49be-a7c7-014069775d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:07:26.139142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c14b-7009-49be-a7c7-014069775d70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:07:26.139915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c14b-7009-49be-a7c7-014069775d70 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:07:26.141298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443c14b-7009-49be-a7c7-014069775d70 None admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:07:26.164349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 655/1306] 10.222.0.45 () {60 vars in 1144 bytes} [Wed May 25 16:07:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:07:35.974170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=30 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:07:36.159628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:30.593017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b230-e5d7-4f38-a7ec-9b51f04c7433 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:30.594939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b230-e5d7-4f38-a7ec-9b51f04c7433 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:30.596286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3b230-e5d7-4f38-a7ec-9b51f04c7433 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:30.601179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 652/1307] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:30.606490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fedf9-bafa-4ae5-bb44-fb24db203a2d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:30.606910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fedf9-bafa-4ae5-bb44-fb24db203a2d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:30.607231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fedf9-bafa-4ae5-bb44-fb24db203a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:30.689365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-576fedf9-bafa-4ae5-bb44-fb24db203a2d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:30.690776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-576fedf9-bafa-4ae5-bb44-fb24db203a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:30.848550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 656/1308] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:30.892009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5769-0f0f-40a4-9b6e-2ee4ff99fe7e None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:30.892696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5769-0f0f-40a4-9b6e-2ee4ff99fe7e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:30.893322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5769-0f0f-40a4-9b6e-2ee4ff99fe7e None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:30.895911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 653/1309] 10.222.0.45 () {54 vars in 964 bytes} [Wed May 25 16:08:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:30.907364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb28895-20d8-438f-9c6b-fb122c46d9be None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:30.907573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb28895-20d8-438f-9c6b-fb122c46d9be None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:30.907967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb28895-20d8-438f-9c6b-fb122c46d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:30.992170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7bb28895-20d8-438f-9c6b-fb122c46d9be None None] MFA Rules not processed for user `99e8bd308e5549618c66d6edaf02523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:30.993453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7bb28895-20d8-438f-9c6b-fb122c46d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:31.015636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:31.082455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 657/1310] 10.222.0.45 () {58 vars in 1061 bytes} [Wed May 25 16:08:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:31.091526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc5769-0f0f-40a4-9b6e-2ee4ff99fe7e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:31.093267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f3fc5769-0f0f-40a4-9b6e-2ee4ff99fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:31.220354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc5769-0f0f-40a4-9b6e-2ee4ff99fe7e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:31.301960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:31.302616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:31.302905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:31.303132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:31.304970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:31.363473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:31.424944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:31.426553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41b501-2f54-4d4e-887a-d844d1663fea service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:31.448735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 654/1311] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:33.927932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc9ad-dc22-4abc-bcd0-8adfe64839fb None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:33.928449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc9ad-dc22-4abc-bcd0-8adfe64839fb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:33.928554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc9ad-dc22-4abc-bcd0-8adfe64839fb None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:33.929884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 658/1312] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:33.935304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1d39e-be5f-4c69-bef6-d8f04d75c405 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:33.935676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1d39e-be5f-4c69-bef6-d8f04d75c405 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:33.935827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1d39e-be5f-4c69-bef6-d8f04d75c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:34.020150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f5c1d39e-be5f-4c69-bef6-d8f04d75c405 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:34.021261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f5c1d39e-be5f-4c69-bef6-d8f04d75c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:34.128749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 655/1313] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:34.166492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc9ad-dc22-4abc-bcd0-8adfe64839fb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:34.168528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8afdc9ad-dc22-4abc-bcd0-8adfe64839fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:34.276259 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc9ad-dc22-4abc-bcd0-8adfe64839fb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:34.349333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:34.352576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:34.353229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:34.354042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:34.354540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:34.357981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:34.476149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:34.477614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b717b4-1586-40e5-91da-d309fcac6ff1 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:34.497383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 659/1314] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:37.040210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bbea5-ee2b-44c8-8269-a7c33a218644 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:37.040829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bbea5-ee2b-44c8-8269-a7c33a218644 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:37.040829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bbea5-ee2b-44c8-8269-a7c33a218644 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:37.042788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 656/1315] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:37.048843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6276-d25b-4655-9a14-5189282dbc3d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:37.049416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6276-d25b-4655-9a14-5189282dbc3d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:37.049416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6276-d25b-4655-9a14-5189282dbc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:37.122992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ce3b6276-d25b-4655-9a14-5189282dbc3d None None] MFA Rules not processed for user `2ed8f18749b54862825a1a3ad3d01a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:37.124311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ce3b6276-d25b-4655-9a14-5189282dbc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:37.182288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:37.229496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 660/1316] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:37.282658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06dc8-ce42-4ed8-8b92-e8cfb1795723 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:37.283037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06dc8-ce42-4ed8-8b92-e8cfb1795723 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:37.283404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d06dc8-ce42-4ed8-8b92-e8cfb1795723 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:37.284823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 657/1317] 10.222.0.45 () {54 vars in 964 bytes} [Wed May 25 16:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:37.290840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a704-d48c-4cb8-a333-c3cf261a9fea None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:37.291078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a704-d48c-4cb8-a333-c3cf261a9fea None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:37.291386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a704-d48c-4cb8-a333-c3cf261a9fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:37.371533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-3d97a704-d48c-4cb8-a333-c3cf261a9fea None None] MFA Rules not processed for user `99e8bd308e5549618c66d6edaf02523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:37.372673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3d97a704-d48c-4cb8-a333-c3cf261a9fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:37.454870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 661/1318] 10.222.0.45 () {58 vars in 1061 bytes} [Wed May 25 16:08:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:37.466976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06dc8-ce42-4ed8-8b92-e8cfb1795723 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:37.468535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-78d06dc8-ce42-4ed8-8b92-e8cfb1795723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:37.480516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:37.583993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d06dc8-ce42-4ed8-8b92-e8cfb1795723 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:37.665803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:37.666450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:37.666758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:37.667393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:37.669138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:37.734325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:37.783291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:37.784767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e26f2-acc7-496c-9380-844d3e49df1a service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:37.803423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 658/1319] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:08:40.933135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83afe9-efbe-4c08-b53f-cfd10fb8d7c5 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:40.934153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83afe9-efbe-4c08-b53f-cfd10fb8d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:40.934153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83afe9-efbe-4c08-b53f-cfd10fb8d7c5 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:40.936283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 662/1320] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:40.945292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7efa0e-b090-4f7f-b376-8c483d138474 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:40.945715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7efa0e-b090-4f7f-b376-8c483d138474 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:40.945921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7efa0e-b090-4f7f-b376-8c483d138474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:41.017526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3c7efa0e-b090-4f7f-b376-8c483d138474 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:41.018731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3c7efa0e-b090-4f7f-b376-8c483d138474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:41.126871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 659/1321] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:41.182401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83afe9-efbe-4c08-b53f-cfd10fb8d7c5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:41.185015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-bb83afe9-efbe-4c08-b53f-cfd10fb8d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:41.244003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:41.304574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83afe9-efbe-4c08-b53f-cfd10fb8d7c5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:41.382809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:41.383504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:41.383787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:41.384055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:41.385687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:41.488244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:41.509177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:41.511498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65917a7-f7bf-4a51-99dc-10b4b077a42b service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:41.533512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 663/1322] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:44.500751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb4e3b-068e-489a-8322-6dfbe52d135a None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:44.501301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb4e3b-068e-489a-8322-6dfbe52d135a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:44.501301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb4e3b-068e-489a-8322-6dfbe52d135a None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:44.502659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 660/1323] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:44.508178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c86a63-44d3-4c0d-b53d-1a93332e891e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:44.508631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c86a63-44d3-4c0d-b53d-1a93332e891e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:44.508735 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c86a63-44d3-4c0d-b53d-1a93332e891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:44.573532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-89c86a63-44d3-4c0d-b53d-1a93332e891e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:44.574828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-89c86a63-44d3-4c0d-b53d-1a93332e891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:44.679194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 664/1324] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:44.714351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb4e3b-068e-489a-8322-6dfbe52d135a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:44.715958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-81eb4e3b-068e-489a-8322-6dfbe52d135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:44.735909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:44.833137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb4e3b-068e-489a-8322-6dfbe52d135a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:44.908776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:44.909487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:44.909777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:44.910057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:44.911732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:44.986918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:45.027075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:45.028879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4158c-5b6d-47f9-a980-bd836c396cc7 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:45.050446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 661/1325] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:47.288699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8217c-3771-4f96-9fcd-608b400b2391 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:47.289250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8217c-3771-4f96-9fcd-608b400b2391 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:47.289250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8217c-3771-4f96-9fcd-608b400b2391 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:47.290639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 665/1326] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:47.296331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229633-ce76-42fa-aa93-25b7165716e9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:47.296772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229633-ce76-42fa-aa93-25b7165716e9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:47.296868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229633-ce76-42fa-aa93-25b7165716e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:47.362107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0d229633-ce76-42fa-aa93-25b7165716e9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:47.363263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0d229633-ce76-42fa-aa93-25b7165716e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:47.467062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 662/1327] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:47.502460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8217c-3771-4f96-9fcd-608b400b2391 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:47.504064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-35c8217c-3771-4f96-9fcd-608b400b2391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:47.566219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:47.611866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8217c-3771-4f96-9fcd-608b400b2391 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:47.687990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:47.688564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:47.688844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:47.689113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:47.690757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:47.802980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:47.806488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:47.808979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c6c3-974d-47ea-81ae-982dd62d6670 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:47.827710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 666/1328] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:08:50.064240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27119c9f-b3fb-4841-87cc-273afb180632 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:50.064779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27119c9f-b3fb-4841-87cc-273afb180632 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:50.064779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27119c9f-b3fb-4841-87cc-273afb180632 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:50.066524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 663/1329] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:50.072407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27419-7a11-4e80-977a-90a60fae2c2e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:50.072843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27419-7a11-4e80-977a-90a60fae2c2e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:50.072934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27419-7a11-4e80-977a-90a60fae2c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:50.143821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6ca27419-7a11-4e80-977a-90a60fae2c2e None None] MFA Rules not processed for user `2ed8f18749b54862825a1a3ad3d01a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:50.145010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6ca27419-7a11-4e80-977a-90a60fae2c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:50.248309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 667/1330] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:50.286044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27119c9f-b3fb-4841-87cc-273afb180632 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:50.287737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-27119c9f-b3fb-4841-87cc-273afb180632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:50.321399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:50.396050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27119c9f-b3fb-4841-87cc-273afb180632 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:50.477032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:50.477738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:50.478022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:50.478297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:50.480004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:50.562264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:50.595852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:50.597296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbc800-4153-47d2-9f16-44a6fdc8204e service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:50.615986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 664/1331] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:53.052000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5be8a-5aba-4853-9c9d-c0d69d3bece2 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:53.052550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5be8a-5aba-4853-9c9d-c0d69d3bece2 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:53.052550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5be8a-5aba-4853-9c9d-c0d69d3bece2 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:53.053955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 668/1332] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:53.059486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bce5-9408-4d78-b266-4ad6ac244d2b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:53.059896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bce5-9408-4d78-b266-4ad6ac244d2b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:53.060042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4bce5-9408-4d78-b266-4ad6ac244d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:53.128336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eaf4bce5-9408-4d78-b266-4ad6ac244d2b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:53.129536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eaf4bce5-9408-4d78-b266-4ad6ac244d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:53.237052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 665/1333] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:53.273423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5be8a-5aba-4853-9c9d-c0d69d3bece2 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:53.274968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-03d5be8a-5aba-4853-9c9d-c0d69d3bece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:53.349330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:53.388682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5be8a-5aba-4853-9c9d-c0d69d3bece2 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:53.468199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:53.468849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:53.469123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:53.469396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:53.471009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:53.590729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:53.592253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b434f07-71f6-4b2b-94a2-de7eba788fb4 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:53.602944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:53.612255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 669/1334] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:55.851866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff7869-f61d-4595-bc2f-522ae375d567 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:55.852749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff7869-f61d-4595-bc2f-522ae375d567 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:55.852749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff7869-f61d-4595-bc2f-522ae375d567 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:55.854914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 666/1335] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:55.860514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f226537-d34a-487a-9363-9544198374a7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:55.860940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f226537-d34a-487a-9363-9544198374a7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:55.861033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f226537-d34a-487a-9363-9544198374a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:55.929991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8f226537-d34a-487a-9363-9544198374a7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:55.931203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8f226537-d34a-487a-9363-9544198374a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:56.046499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 670/1336] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:56.087531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff7869-f61d-4595-bc2f-522ae375d567 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:56.089745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8bff7869-f61d-4595-bc2f-522ae375d567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:56.135619 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:56.207790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff7869-f61d-4595-bc2f-522ae375d567 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:56.295270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:56.295936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:56.296220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:56.296494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:56.298173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:56.391765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:56.418496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:56.419996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5037f-f91d-4618-8bcf-bb0128f6da39 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:56.441336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 667/1337] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:08:58.996470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be66e9-c4f9-4954-bb5f-abdf0c85d4c7 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:58.997111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be66e9-c4f9-4954-bb5f-abdf0c85d4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:58.997111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be66e9-c4f9-4954-bb5f-abdf0c85d4c7 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:58.998398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 671/1338] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:08:59.004950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1e7d-3760-4a32-a2fe-a94b6353199d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:59.005709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1e7d-3760-4a32-a2fe-a94b6353199d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:59.005873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc1e7d-3760-4a32-a2fe-a94b6353199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:59.079989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-69bc1e7d-3760-4a32-a2fe-a94b6353199d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:08:59.081190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-69bc1e7d-3760-4a32-a2fe-a94b6353199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:59.182974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 668/1339] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:08:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:08:59.221535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be66e9-c4f9-4954-bb5f-abdf0c85d4c7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:08:59.223125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d0be66e9-c4f9-4954-bb5f-abdf0c85d4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:59.313835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:08:59.342794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be66e9-c4f9-4954-bb5f-abdf0c85d4c7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:08:59.417776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:08:59.418425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:08:59.418701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:08:59.418974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:08:59.420640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:08:59.536722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:08:59.538163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d9ed1-3b6a-4ce0-959c-dd11dbf3d8f0 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:08:59.557020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 672/1340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:08:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:09:03.864943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760968-5b98-4b05-9d55-0985b3b60c4a None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:03.865549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760968-5b98-4b05-9d55-0985b3b60c4a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:03.865549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1760968-5b98-4b05-9d55-0985b3b60c4a None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:03.866975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 669/1341] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:03.872515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643df3-c6f7-45eb-aef0-fe4248311370 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:03.873025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643df3-c6f7-45eb-aef0-fe4248311370 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:03.873025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd643df3-c6f7-45eb-aef0-fe4248311370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:03.880287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:03.947214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-bd643df3-c6f7-45eb-aef0-fe4248311370 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:03.948435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-bd643df3-c6f7-45eb-aef0-fe4248311370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:04.051839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 673/1342] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:04.090205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760968-5b98-4b05-9d55-0985b3b60c4a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:04.092740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e1760968-5b98-4b05-9d55-0985b3b60c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:04.146759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:04.195570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1760968-5b98-4b05-9d55-0985b3b60c4a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:04.199582 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952343d9-a3c5-46ac-b736-700a57986c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:04.200254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952343d9-a3c5-46ac-b736-700a57986c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:04.200534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952343d9-a3c5-46ac-b736-700a57986c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:04.200808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952343d9-a3c5-46ac-b736-700a57986c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:04.210732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952343d9-a3c5-46ac-b736-700a57986c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:04.212193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952343d9-a3c5-46ac-b736-700a57986c2f service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:04.221834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 670/1343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:07.004809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebee53-1cf8-4c78-8641-b8a234760332 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:07.005336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebee53-1cf8-4c78-8641-b8a234760332 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:07.005336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ebee53-1cf8-4c78-8641-b8a234760332 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:07.006839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 674/1344] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:07.012130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af0201-ffd6-4fbb-9bb1-0c9a9101d927 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:07.012577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af0201-ffd6-4fbb-9bb1-0c9a9101d927 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:07.012805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af0201-ffd6-4fbb-9bb1-0c9a9101d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:07.042288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f9af0201-ffd6-4fbb-9bb1-0c9a9101d927 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:07.043459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f9af0201-ffd6-4fbb-9bb1-0c9a9101d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:07.126153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 671/1345] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:07.163407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebee53-1cf8-4c78-8641-b8a234760332 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:07.175465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ebee53-1cf8-4c78-8641-b8a234760332 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:07.179477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27bd64-53f3-4349-9207-16292829029b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:07.180122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bd64-53f3-4349-9207-16292829029b service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:07.180407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bd64-53f3-4349-9207-16292829029b service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:07.180685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27bd64-53f3-4349-9207-16292829029b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:07.189831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27bd64-53f3-4349-9207-16292829029b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:07.191301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27bd64-53f3-4349-9207-16292829029b service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:07.200936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 675/1346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:11.277209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76581fd-86c6-471b-bacb-209752328188 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:11.277745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76581fd-86c6-471b-bacb-209752328188 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:11.277745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76581fd-86c6-471b-bacb-209752328188 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:11.279128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 672/1347] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:11.287746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b550-7908-4472-9edb-e55017505822 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:11.288214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b550-7908-4472-9edb-e55017505822 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:11.288319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635b550-7908-4472-9edb-e55017505822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:11.307915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a635b550-7908-4472-9edb-e55017505822 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:11.309117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a635b550-7908-4472-9edb-e55017505822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:11.317451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 676/1348] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:11.355019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76581fd-86c6-471b-bacb-209752328188 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:11.367636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76581fd-86c6-471b-bacb-209752328188 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:11.371549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dcad2-7758-4a51-b27a-514b545d5aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:11.372199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dcad2-7758-4a51-b27a-514b545d5aca service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:11.372478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dcad2-7758-4a51-b27a-514b545d5aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:11.372749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dcad2-7758-4a51-b27a-514b545d5aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:11.381891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dcad2-7758-4a51-b27a-514b545d5aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:11.383395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dcad2-7758-4a51-b27a-514b545d5aca service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:11.393661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 673/1349] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:16.809611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137963-58f3-4de5-896b-7ef76e9f6593 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:16.810160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137963-58f3-4de5-896b-7ef76e9f6593 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:16.810160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db137963-58f3-4de5-896b-7ef76e9f6593 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:16.811597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 677/1350] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:16.818091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fba9f-8036-4bd6-9407-592d58f23da3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:16.818546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fba9f-8036-4bd6-9407-592d58f23da3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:16.818789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fba9f-8036-4bd6-9407-592d58f23da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:16.910629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0f9fba9f-8036-4bd6-9407-592d58f23da3 None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:16.912278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0f9fba9f-8036-4bd6-9407-592d58f23da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:16.955086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:17.048148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 674/1351] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:09:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:21.147756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becf97c-8be8-4934-aa57-4acace73362c None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:21.148304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becf97c-8be8-4934-aa57-4acace73362c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:21.148542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becf97c-8be8-4934-aa57-4acace73362c None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:21.150158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 678/1352] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:21.155551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4fe86-4daa-48c8-bfce-cca1a9b34c43 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:21.156024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4fe86-4daa-48c8-bfce-cca1a9b34c43 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:21.156117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4fe86-4daa-48c8-bfce-cca1a9b34c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:21.176232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c6c4fe86-4daa-48c8-bfce-cca1a9b34c43 None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:21.177546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c6c4fe86-4daa-48c8-bfce-cca1a9b34c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:21.187048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 675/1353] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:09:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:21.302783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=72 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:22.696543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020ebc-ac1b-4f3b-b7f9-0c37e59d7b27 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:22.697193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020ebc-ac1b-4f3b-b7f9-0c37e59d7b27 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:22.697193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96020ebc-ac1b-4f3b-b7f9-0c37e59d7b27 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:22.698686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 679/1354] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:22.703728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682ecf5-34a1-4ad0-b60f-7aafafc93661 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:22.704162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682ecf5-34a1-4ad0-b60f-7aafafc93661 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:22.704371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682ecf5-34a1-4ad0-b60f-7aafafc93661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:22.722939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-2682ecf5-34a1-4ad0-b60f-7aafafc93661 None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:22.724174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2682ecf5-34a1-4ad0-b60f-7aafafc93661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:22.733531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 676/1355] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:09:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:26.661422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6af7-dc06-4e0f-a30b-2473bfc7fbfa None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:26.661978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6af7-dc06-4e0f-a30b-2473bfc7fbfa None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:26.661978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6af7-dc06-4e0f-a30b-2473bfc7fbfa None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:26.663500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 680/1356] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:26.669125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7e9f-92be-4e86-b8a9-937b61219579 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:26.669580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7e9f-92be-4e86-b8a9-937b61219579 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:26.669686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7e9f-92be-4e86-b8a9-937b61219579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:26.688253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c00e7e9f-92be-4e86-b8a9-937b61219579 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:26.689457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c00e7e9f-92be-4e86-b8a9-937b61219579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:26.698064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 677/1357] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:26.750072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616d315-a269-4f1b-b8df-6cbfc7482bef None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:26.750577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616d315-a269-4f1b-b8df-6cbfc7482bef None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:26.751004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616d315-a269-4f1b-b8df-6cbfc7482bef None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:26.752570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 681/1358] 10.222.0.45 () {54 vars in 961 bytes} [Wed May 25 16:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:26.764316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35783-0146-41dd-8c4f-d8a0b6e4a7fa None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:26.765090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35783-0146-41dd-8c4f-d8a0b6e4a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:26.765435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c35783-0146-41dd-8c4f-d8a0b6e4a7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:26.830660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-21c35783-0146-41dd-8c4f-d8a0b6e4a7fa None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:26.831993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-21c35783-0146-41dd-8c4f-d8a0b6e4a7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:26.916772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 678/1359] 10.222.0.45 () {58 vars in 1058 bytes} [Wed May 25 16:09:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:26.924797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616d315-a269-4f1b-b8df-6cbfc7482bef None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:26.949671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616d315-a269-4f1b-b8df-6cbfc7482bef None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:26.955465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541460-19ba-49d7-8a4c-3a3e15d46ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:26.956092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541460-19ba-49d7-8a4c-3a3e15d46ec5 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:26.956573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541460-19ba-49d7-8a4c-3a3e15d46ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:26.956825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541460-19ba-49d7-8a4c-3a3e15d46ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:26.966184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541460-19ba-49d7-8a4c-3a3e15d46ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:26.967823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541460-19ba-49d7-8a4c-3a3e15d46ec5 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:26.977664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 682/1360] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:29.397966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36457-e617-41d2-a495-faadb308b14e None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:29.398570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36457-e617-41d2-a495-faadb308b14e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:29.398570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca36457-e617-41d2-a495-faadb308b14e None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:29.400010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 679/1361] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:29.405145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4331d2-025f-42dc-9435-e58d4471c943 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:29.405587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4331d2-025f-42dc-9435-e58d4471c943 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:29.405680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4331d2-025f-42dc-9435-e58d4471c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:29.424041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ab4331d2-025f-42dc-9435-e58d4471c943 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:29.425241 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ab4331d2-025f-42dc-9435-e58d4471c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:29.433183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 683/1362] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:29.477719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36457-e617-41d2-a495-faadb308b14e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:29.492615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca36457-e617-41d2-a495-faadb308b14e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:29.499215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99a36d-c994-4627-969b-23d4b788748c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:29.499890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a36d-c994-4627-969b-23d4b788748c service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:29.500168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a36d-c994-4627-969b-23d4b788748c service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:29.500437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99a36d-c994-4627-969b-23d4b788748c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:29.509530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99a36d-c994-4627-969b-23d4b788748c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:29.511129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99a36d-c994-4627-969b-23d4b788748c service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:29.520614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 680/1363] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:32.052555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dedd80-7f29-413b-b92d-8e6a9326a70f None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:32.058410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dedd80-7f29-413b-b92d-8e6a9326a70f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:32.058933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dedd80-7f29-413b-b92d-8e6a9326a70f None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:32.061513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 684/1364] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:32.067862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0985c5a-f8a8-4a2f-b3c6-c5d92a0dbe04 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:32.068387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0985c5a-f8a8-4a2f-b3c6-c5d92a0dbe04 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:32.068387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0985c5a-f8a8-4a2f-b3c6-c5d92a0dbe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:32.086777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a0985c5a-f8a8-4a2f-b3c6-c5d92a0dbe04 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:32.088011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a0985c5a-f8a8-4a2f-b3c6-c5d92a0dbe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:32.095990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 681/1365] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:32.144532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4900-c50a-4824-b0c5-6840693a15f9 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:32.145033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4900-c50a-4824-b0c5-6840693a15f9 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:32.145464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca4900-c50a-4824-b0c5-6840693a15f9 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:32.150903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 685/1366] 10.222.0.45 () {54 vars in 961 bytes} [Wed May 25 16:09:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:32.152598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9238b-5dc3-4b83-baba-c37755b5ca4d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:32.152924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9238b-5dc3-4b83-baba-c37755b5ca4d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:32.153167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9238b-5dc3-4b83-baba-c37755b5ca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:32.183559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b5a9238b-5dc3-4b83-baba-c37755b5ca4d None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:32.185015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b5a9238b-5dc3-4b83-baba-c37755b5ca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:32.195689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 682/1367] 10.222.0.45 () {58 vars in 1058 bytes} [Wed May 25 16:09:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:32.203568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4900-c50a-4824-b0c5-6840693a15f9 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:32.217887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca4900-c50a-4824-b0c5-6840693a15f9 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:32.225551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad746b6-8985-41e3-b2ef-cf29df2e30d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:32.226409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad746b6-8985-41e3-b2ef-cf29df2e30d2 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:32.226844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad746b6-8985-41e3-b2ef-cf29df2e30d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:32.227307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad746b6-8985-41e3-b2ef-cf29df2e30d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:32.236624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad746b6-8985-41e3-b2ef-cf29df2e30d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:32.238741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad746b6-8985-41e3-b2ef-cf29df2e30d2 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:32.249392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 686/1368] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:34.514262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be2a1-3521-4fcb-b45f-5cfb060d50d9 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:34.514798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be2a1-3521-4fcb-b45f-5cfb060d50d9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:34.514798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67be2a1-3521-4fcb-b45f-5cfb060d50d9 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:34.516179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 683/1369] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:34.521912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293b04-125b-4b64-b2ce-70de601a7c12 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:34.522418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293b04-125b-4b64-b2ce-70de601a7c12 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:34.522418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293b04-125b-4b64-b2ce-70de601a7c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:34.540908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-38293b04-125b-4b64-b2ce-70de601a7c12 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:34.542449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-38293b04-125b-4b64-b2ce-70de601a7c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:34.550637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 687/1370] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:34.595421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be2a1-3521-4fcb-b45f-5cfb060d50d9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:34.612407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67be2a1-3521-4fcb-b45f-5cfb060d50d9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:34.618621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba974d-469f-456a-81ed-1fa4876afa15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:34.619431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba974d-469f-456a-81ed-1fa4876afa15 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:34.619717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba974d-469f-456a-81ed-1fa4876afa15 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:34.619985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba974d-469f-456a-81ed-1fa4876afa15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:34.630380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba974d-469f-456a-81ed-1fa4876afa15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:34.632112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba974d-469f-456a-81ed-1fa4876afa15 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:34.643595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 684/1371] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:34.819870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822700f-6af2-4659-8c7e-06f195711a2e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:34.820144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822700f-6af2-4659-8c7e-06f195711a2e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:34.820422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822700f-6af2-4659-8c7e-06f195711a2e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:34.821842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 688/1372] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:34.827959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e0b13-a6e8-4370-a05f-15d6f6aa94b0 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:34.828238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e0b13-a6e8-4370-a05f-15d6f6aa94b0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:34.828515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e0b13-a6e8-4370-a05f-15d6f6aa94b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:34.848230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6f8e0b13-a6e8-4370-a05f-15d6f6aa94b0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:34.849810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6f8e0b13-a6e8-4370-a05f-15d6f6aa94b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:34.858567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 685/1373] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:35.165879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d4ab1-6ecc-46fa-b0b8-cb4ea4917f2e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:35.166129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d4ab1-6ecc-46fa-b0b8-cb4ea4917f2e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:35.166435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d4ab1-6ecc-46fa-b0b8-cb4ea4917f2e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:35.168433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 689/1374] 10.222.0.45 () {54 vars in 963 bytes} [Wed May 25 16:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:35.174748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8232b86-010c-4973-aafa-468089243e48 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:35.175297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8232b86-010c-4973-aafa-468089243e48 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:35.175678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8232b86-010c-4973-aafa-468089243e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:35.183432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:35.231816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d8232b86-010c-4973-aafa-468089243e48 None None] MFA Rules not processed for user `9eb3714586bf4b50a1a9b29358f92b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:35.233164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d8232b86-010c-4973-aafa-468089243e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:35.299663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 686/1375] 10.222.0.45 () {58 vars in 1060 bytes} [Wed May 25 16:09:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:35.307545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d4ab1-6ecc-46fa-b0b8-cb4ea4917f2e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:35.318830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d4ab1-6ecc-46fa-b0b8-cb4ea4917f2e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:35.322835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe425f27-e872-418a-a70d-a0c313a98489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:35.323650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe425f27-e872-418a-a70d-a0c313a98489 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:35.324026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe425f27-e872-418a-a70d-a0c313a98489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:35.324611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe425f27-e872-418a-a70d-a0c313a98489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:35.334163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe425f27-e872-418a-a70d-a0c313a98489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:35.335764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe425f27-e872-418a-a70d-a0c313a98489 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:35.345675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 690/1376] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:36.928679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b07e1-d9e9-4ad7-a2dc-f63217dc09a5 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:36.928679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b07e1-d9e9-4ad7-a2dc-f63217dc09a5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:36.928679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b07e1-d9e9-4ad7-a2dc-f63217dc09a5 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:36.929732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 687/1377] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:36.930458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07fd0b-9428-4ee1-a2f4-42216ab2d1b0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:36.930940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07fd0b-9428-4ee1-a2f4-42216ab2d1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:36.931112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07fd0b-9428-4ee1-a2f4-42216ab2d1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:36.951654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4c07fd0b-9428-4ee1-a2f4-42216ab2d1b0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:36.953049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4c07fd0b-9428-4ee1-a2f4-42216ab2d1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:36.964703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 691/1378] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:37.012123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b07e1-d9e9-4ad7-a2dc-f63217dc09a5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:37.027243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b07e1-d9e9-4ad7-a2dc-f63217dc09a5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:37.032985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e6e01-9ebe-4823-ae06-e99aabb1f09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:37.033656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e6e01-9ebe-4823-ae06-e99aabb1f09e service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:37.034124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e6e01-9ebe-4823-ae06-e99aabb1f09e service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:37.034405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e6e01-9ebe-4823-ae06-e99aabb1f09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:37.048994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e6e01-9ebe-4823-ae06-e99aabb1f09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:37.050700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e6e01-9ebe-4823-ae06-e99aabb1f09e service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:37.061568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 688/1379] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:09:39.287226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd89ac-8965-4273-900e-a55163d6257f None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:39.287779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd89ac-8965-4273-900e-a55163d6257f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:39.287779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd89ac-8965-4273-900e-a55163d6257f None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:39.290191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 692/1380] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:39.294916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b698c90-9e0e-4465-8a97-a9e032ccb54e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:39.295429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b698c90-9e0e-4465-8a97-a9e032ccb54e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:39.295525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b698c90-9e0e-4465-8a97-a9e032ccb54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:39.315280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3b698c90-9e0e-4465-8a97-a9e032ccb54e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:39.316460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3b698c90-9e0e-4465-8a97-a9e032ccb54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:39.325229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 689/1381] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:39.368772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd89ac-8965-4273-900e-a55163d6257f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:39.384501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd89ac-8965-4273-900e-a55163d6257f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:39.390840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62128425-4c78-45dc-a3ce-5f03d7a4473d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:39.391607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128425-4c78-45dc-a3ce-5f03d7a4473d service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:39.391955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128425-4c78-45dc-a3ce-5f03d7a4473d service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:39.392289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62128425-4c78-45dc-a3ce-5f03d7a4473d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:39.401978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62128425-4c78-45dc-a3ce-5f03d7a4473d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:39.403752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62128425-4c78-45dc-a3ce-5f03d7a4473d service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:39.413679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 693/1382] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:41.640563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d7f7-face-4f7a-b44f-39968689dc6a None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:41.641144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d7f7-face-4f7a-b44f-39968689dc6a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:41.641144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749d7f7-face-4f7a-b44f-39968689dc6a None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:41.642425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 690/1383] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:41.648098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f0f0-2aa6-4752-87be-aef5fb3b0cd6 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:41.648555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f0f0-2aa6-4752-87be-aef5fb3b0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:41.648638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f0f0-2aa6-4752-87be-aef5fb3b0cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:41.666537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-d1d8f0f0-2aa6-4752-87be-aef5fb3b0cd6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:41.667977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d1d8f0f0-2aa6-4752-87be-aef5fb3b0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:41.676051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 694/1384] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:09:41.716527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d7f7-face-4f7a-b44f-39968689dc6a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:41.731457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749d7f7-face-4f7a-b44f-39968689dc6a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:41.736881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cddc6b-02ce-4c12-8b35-52e6914fc5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:41.737543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cddc6b-02ce-4c12-8b35-52e6914fc5ad service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:41.737824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cddc6b-02ce-4c12-8b35-52e6914fc5ad service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:41.738118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cddc6b-02ce-4c12-8b35-52e6914fc5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:41.747185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cddc6b-02ce-4c12-8b35-52e6914fc5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:41.748808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cddc6b-02ce-4c12-8b35-52e6914fc5ad service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:41.758620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 691/1385] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:43.970893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733ac3-89a2-4250-80e0-c11bda48682c None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:43.971498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733ac3-89a2-4250-80e0-c11bda48682c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:43.971498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49733ac3-89a2-4250-80e0-c11bda48682c None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:43.972858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 695/1386] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:43.978154 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495472-4457-4120-ab4a-644c1fe597ef None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:43.978555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495472-4457-4120-ab4a-644c1fe597ef None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:43.978710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495472-4457-4120-ab4a-644c1fe597ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:43.999893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ac495472-4457-4120-ab4a-644c1fe597ef None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:44.001327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ac495472-4457-4120-ab4a-644c1fe597ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:44.012748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 692/1387] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:44.058752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733ac3-89a2-4250-80e0-c11bda48682c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:44.076678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49733ac3-89a2-4250-80e0-c11bda48682c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:44.083530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ab8c7-2a49-4d61-b95a-a9a364c2b386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:44.084187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab8c7-2a49-4d61-b95a-a9a364c2b386 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:44.084462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab8c7-2a49-4d61-b95a-a9a364c2b386 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:44.084727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ab8c7-2a49-4d61-b95a-a9a364c2b386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:44.093748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ab8c7-2a49-4d61-b95a-a9a364c2b386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:44.095362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ab8c7-2a49-4d61-b95a-a9a364c2b386 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:44.104676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 696/1388] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:46.874065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07cc7-e887-4154-ab37-c052f7bf2c05 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:46.874644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07cc7-e887-4154-ab37-c052f7bf2c05 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:46.874759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a07cc7-e887-4154-ab37-c052f7bf2c05 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:46.876620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 693/1389] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:46.883045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638487-39ff-43bb-9ea1-5027eb8c30dd None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:46.883480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638487-39ff-43bb-9ea1-5027eb8c30dd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:46.883629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7638487-39ff-43bb-9ea1-5027eb8c30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:46.901717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-e7638487-39ff-43bb-9ea1-5027eb8c30dd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:46.902964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e7638487-39ff-43bb-9ea1-5027eb8c30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:46.911587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 697/1390] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:46.956245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07cc7-e887-4154-ab37-c052f7bf2c05 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:46.970845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a07cc7-e887-4154-ab37-c052f7bf2c05 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:46.976685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c22e9a-d53f-42c5-8082-813bdc7eb94c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:46.977363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22e9a-d53f-42c5-8082-813bdc7eb94c service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:46.977653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22e9a-d53f-42c5-8082-813bdc7eb94c service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:46.977927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c22e9a-d53f-42c5-8082-813bdc7eb94c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:46.987116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22e9a-d53f-42c5-8082-813bdc7eb94c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:46.989241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c22e9a-d53f-42c5-8082-813bdc7eb94c service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:47.001172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 694/1391] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:09:49.214142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039af9-6cbd-4c90-8b3f-04c67eb1e345 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:49.214919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039af9-6cbd-4c90-8b3f-04c67eb1e345 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:49.214919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70039af9-6cbd-4c90-8b3f-04c67eb1e345 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:49.216151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 698/1392] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:49.222606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e24b-7732-4473-b2f9-a2bb5571a478 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:49.223085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e24b-7732-4473-b2f9-a2bb5571a478 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:49.223219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e24b-7732-4473-b2f9-a2bb5571a478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:49.241715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3620e24b-7732-4473-b2f9-a2bb5571a478 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:49.242902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3620e24b-7732-4473-b2f9-a2bb5571a478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:49.250814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 695/1393] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:49.296868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039af9-6cbd-4c90-8b3f-04c67eb1e345 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:49.313819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70039af9-6cbd-4c90-8b3f-04c67eb1e345 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:49.320150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6cf61-f27c-4c5c-b3f0-6095f6178978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:49.320761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cf61-f27c-4c5c-b3f0-6095f6178978 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:49.321082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cf61-f27c-4c5c-b3f0-6095f6178978 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:49.321387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6cf61-f27c-4c5c-b3f0-6095f6178978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:49.330372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cf61-f27c-4c5c-b3f0-6095f6178978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:49.332090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6cf61-f27c-4c5c-b3f0-6095f6178978 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:49.342316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 699/1394] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:51.558139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369d94-5fe5-4be1-a1ca-b57ca1dad3a4 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:51.558779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369d94-5fe5-4be1-a1ca-b57ca1dad3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:51.558779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe369d94-5fe5-4be1-a1ca-b57ca1dad3a4 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:51.560083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 696/1395] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:51.565509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73d9ea-5f6d-4fd4-bce7-76088d9e7243 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:51.565951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73d9ea-5f6d-4fd4-bce7-76088d9e7243 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:51.566055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73d9ea-5f6d-4fd4-bce7-76088d9e7243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:51.572514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=52 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:51.586176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1d73d9ea-5f6d-4fd4-bce7-76088d9e7243 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:51.587388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1d73d9ea-5f6d-4fd4-bce7-76088d9e7243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:51.596118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 700/1396] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:51.641463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369d94-5fe5-4be1-a1ca-b57ca1dad3a4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:51.657554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe369d94-5fe5-4be1-a1ca-b57ca1dad3a4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:51.664518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0a380-ed8d-4b7b-85b8-fc4689dfcf33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:51.665150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0a380-ed8d-4b7b-85b8-fc4689dfcf33 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:51.665434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0a380-ed8d-4b7b-85b8-fc4689dfcf33 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:51.665709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0a380-ed8d-4b7b-85b8-fc4689dfcf33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:51.675133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0a380-ed8d-4b7b-85b8-fc4689dfcf33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:51.676764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0a380-ed8d-4b7b-85b8-fc4689dfcf33 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:51.686732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 697/1397] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:52.246064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090e073-353b-4395-94e4-09fa2f55e6de None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:52.246333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090e073-353b-4395-94e4-09fa2f55e6de None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:52.246608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090e073-353b-4395-94e4-09fa2f55e6de None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:52.248110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 701/1398] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:52.253636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79896aef-8972-4434-8dd9-74cbd8a2a7e6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:52.253962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79896aef-8972-4434-8dd9-74cbd8a2a7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:52.254240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79896aef-8972-4434-8dd9-74cbd8a2a7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:52.282910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-79896aef-8972-4434-8dd9-74cbd8a2a7e6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:52.284150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-79896aef-8972-4434-8dd9-74cbd8a2a7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:52.295201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 698/1399] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:52.353761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de1fd2-b8d2-459a-b148-a580abebb741 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:52.354108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de1fd2-b8d2-459a-b148-a580abebb741 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:52.354304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de1fd2-b8d2-459a-b148-a580abebb741 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:52.355962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 702/1400] 10.222.0.45 () {54 vars in 962 bytes} [Wed May 25 16:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:52.361927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6053ec-2c7e-435a-ae1e-80463a570768 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:52.362227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6053ec-2c7e-435a-ae1e-80463a570768 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:52.362482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6053ec-2c7e-435a-ae1e-80463a570768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:52.419616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ea6053ec-2c7e-435a-ae1e-80463a570768 None None] MFA Rules not processed for user `096d124cc0484429858b2e5f6790ecb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:52.420828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ea6053ec-2c7e-435a-ae1e-80463a570768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:52.456047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:52.485798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 699/1401] 10.222.0.45 () {58 vars in 1059 bytes} [Wed May 25 16:09:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:52.493728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de1fd2-b8d2-459a-b148-a580abebb741 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:52.504980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de1fd2-b8d2-459a-b148-a580abebb741 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:52.508474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81459d63-629c-4b4e-9b33-e44531b49537 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:52.509118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81459d63-629c-4b4e-9b33-e44531b49537 service glance] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:52.509397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81459d63-629c-4b4e-9b33-e44531b49537 service glance] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:52.509668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81459d63-629c-4b4e-9b33-e44531b49537 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:52.519117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81459d63-629c-4b4e-9b33-e44531b49537 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:52.520636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81459d63-629c-4b4e-9b33-e44531b49537 service glance] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:52.530774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 703/1402] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:09:53.070482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf32d11-fd77-4844-a354-3920a0d0caf7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:53.070917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf32d11-fd77-4844-a354-3920a0d0caf7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:53.071025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf32d11-fd77-4844-a354-3920a0d0caf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:53.121512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dcf32d11-fd77-4844-a354-3920a0d0caf7 None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:53.122707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dcf32d11-fd77-4844-a354-3920a0d0caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:53.190337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 700/1403] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:09:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:53.230156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5438a-90e4-436f-8eb2-1183b9e6ee42 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:53.230660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5438a-90e4-436f-8eb2-1183b9e6ee42 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:53.230779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5438a-90e4-436f-8eb2-1183b9e6ee42 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:53.232141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 704/1404] 10.222.0.45 () {54 vars in 942 bytes} [Wed May 25 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:53.238623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6d68-3836-4547-9a93-63bca62bdc8b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:53.238986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6d68-3836-4547-9a93-63bca62bdc8b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:53.239355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6d68-3836-4547-9a93-63bca62bdc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:53.289007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-cacb6d68-3836-4547-9a93-63bca62bdc8b None None] MFA Rules not processed for user `7a55b74ae1f54fbd81f9459c12f0e10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:53.290212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cacb6d68-3836-4547-9a93-63bca62bdc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:53.371708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 701/1405] 10.222.0.45 () {58 vars in 1039 bytes} [Wed May 25 16:09:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:53.381335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5438a-90e4-436f-8eb2-1183b9e6ee42 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:53.396402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5438a-90e4-436f-8eb2-1183b9e6ee42 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:53.401515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b02f4-19d0-4462-a4e3-35e4251df8d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:53.402148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b02f4-19d0-4462-a4e3-35e4251df8d7 service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:53.402427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b02f4-19d0-4462-a4e3-35e4251df8d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:53.402699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b02f4-19d0-4462-a4e3-35e4251df8d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:53.411035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b02f4-19d0-4462-a4e3-35e4251df8d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:53.412639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b02f4-19d0-4462-a4e3-35e4251df8d7 service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:53.421298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 705/1406] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:09:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:09:53.920979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f72b-8010-4573-9d11-ae0462699b04 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:53.921270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f72b-8010-4573-9d11-ae0462699b04 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:53.921657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f72b-8010-4573-9d11-ae0462699b04 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:53.923055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 702/1407] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:09:53.928381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619b95-feca-457e-bcb4-65977eaa4955 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:53.928942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619b95-feca-457e-bcb4-65977eaa4955 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:53.929409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42619b95-feca-457e-bcb4-65977eaa4955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:53.949798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-42619b95-feca-457e-bcb4-65977eaa4955 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:09:53.951083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-42619b95-feca-457e-bcb4-65977eaa4955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:09:53.958872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 706/1408] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:09:54.002239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f72b-8010-4573-9d11-ae0462699b04 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:09:54.026394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db18f72b-8010-4573-9d11-ae0462699b04 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:09:54.032863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74946a4-86ef-4194-a59d-831cb9b3ba6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:09:54.033529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74946a4-86ef-4194-a59d-831cb9b3ba6b service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:09:54.033812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74946a4-86ef-4194-a59d-831cb9b3ba6b service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:09:54.034085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74946a4-86ef-4194-a59d-831cb9b3ba6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:09:54.044970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74946a4-86ef-4194-a59d-831cb9b3ba6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:09:54.046628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74946a4-86ef-4194-a59d-831cb9b3ba6b service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:09:54.052128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:09:54.058433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 703/1409] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:03.944423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=17 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:16.451636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0dbed-721d-448c-aa94-3efb9bd1c995 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:16.452344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0dbed-721d-448c-aa94-3efb9bd1c995 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:16.452344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0dbed-721d-448c-aa94-3efb9bd1c995 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:16.453455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 707/1410] 10.222.0.45 () {54 vars in 918 bytes} [Wed May 25 16:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:16.459065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9dfb9-2f87-40c7-98f3-579230ad1d61 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:16.459581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9dfb9-2f87-40c7-98f3-579230ad1d61 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:16.459684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9dfb9-2f87-40c7-98f3-579230ad1d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:16.479017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3ac9dfb9-2f87-40c7-98f3-579230ad1d61 None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:16.480214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3ac9dfb9-2f87-40c7-98f3-579230ad1d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:16.489979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 704/1411] 10.222.0.45 () {58 vars in 1015 bytes} [Wed May 25 16:10:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:16.504400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c461ccd-0840-486a-95c6-abfd7bfd3b88 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:16.504692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c461ccd-0840-486a-95c6-abfd7bfd3b88 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:16.504970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c461ccd-0840-486a-95c6-abfd7bfd3b88 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:16.507257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 708/1412] 10.222.0.45 () {54 vars in 918 bytes} [Wed May 25 16:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:16.511242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3ab49-474c-42bd-844e-9ab03f07f405 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:16.511537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3ab49-474c-42bd-844e-9ab03f07f405 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:16.511812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3ab49-474c-42bd-844e-9ab03f07f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:16.531078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-88e3ab49-474c-42bd-844e-9ab03f07f405 None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:16.532337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-88e3ab49-474c-42bd-844e-9ab03f07f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:16.543728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 705/1413] 10.222.0.45 () {58 vars in 1015 bytes} [Wed May 25 16:10:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:19.225423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e660-d8d9-48bf-b75b-cd4af1d1312b None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:19.226315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e660-d8d9-48bf-b75b-cd4af1d1312b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:19.226315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62e660-d8d9-48bf-b75b-cd4af1d1312b None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:19.228509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:19.234849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e3626-74f3-4322-b324-c3432f3541a3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:19.235607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e3626-74f3-4322-b324-c3432f3541a3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:19.235788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e3626-74f3-4322-b324-c3432f3541a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:19.256170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7b9e3626-74f3-4322-b324-c3432f3541a3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:19.257386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7b9e3626-74f3-4322-b324-c3432f3541a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:19.266545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:19.311418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e660-d8d9-48bf-b75b-cd4af1d1312b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:19.328301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62e660-d8d9-48bf-b75b-cd4af1d1312b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:19.333682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5ae19-517d-41bd-a16d-22c5c58659cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:19.334317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ae19-517d-41bd-a16d-22c5c58659cf service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:19.334598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ae19-517d-41bd-a16d-22c5c58659cf service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:19.334870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ae19-517d-41bd-a16d-22c5c58659cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:19.342964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5ae19-517d-41bd-a16d-22c5c58659cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:19.344590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5ae19-517d-41bd-a16d-22c5c58659cf service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:19.354233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 710/1416] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:20.320143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093c89-1770-43b9-970e-40477c41f83d None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:20.320701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093c89-1770-43b9-970e-40477c41f83d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:20.320701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13093c89-1770-43b9-970e-40477c41f83d None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:20.321990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:20.328096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710ff01-5a9c-448a-b857-9d40d891bfc0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:20.328820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710ff01-5a9c-448a-b857-9d40d891bfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:20.328997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710ff01-5a9c-448a-b857-9d40d891bfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:20.350393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c710ff01-5a9c-448a-b857-9d40d891bfc0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:20.351616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c710ff01-5a9c-448a-b857-9d40d891bfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:20.360953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:20.516302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093c89-1770-43b9-970e-40477c41f83d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:20.536408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13093c89-1770-43b9-970e-40477c41f83d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:20.543622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90163d3-bf37-41b7-8a5b-08316116bfbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:20.544264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90163d3-bf37-41b7-8a5b-08316116bfbf service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:20.544546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90163d3-bf37-41b7-8a5b-08316116bfbf service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:20.544818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90163d3-bf37-41b7-8a5b-08316116bfbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:20.554751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90163d3-bf37-41b7-8a5b-08316116bfbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:20.557344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90163d3-bf37-41b7-8a5b-08316116bfbf service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:20.573748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 708/1419] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:21.504623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5b28-c66e-4874-a30a-898bf24f582d None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:21.505455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5b28-c66e-4874-a30a-898bf24f582d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:21.505455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5b28-c66e-4874-a30a-898bf24f582d None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:21.507629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:21.513614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e89efb-6c82-4c17-99b3-2164dd54cca7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:21.514334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e89efb-6c82-4c17-99b3-2164dd54cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:21.514510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e89efb-6c82-4c17-99b3-2164dd54cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:21.535721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-58e89efb-6c82-4c17-99b3-2164dd54cca7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:21.536925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-58e89efb-6c82-4c17-99b3-2164dd54cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:21.546634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:21.698111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5b28-c66e-4874-a30a-898bf24f582d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:21.713904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5b28-c66e-4874-a30a-898bf24f582d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:21.720319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb5be1-1c56-429f-8a12-22dafd593d47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:21.720958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5be1-1c56-429f-8a12-22dafd593d47 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:21.721242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5be1-1c56-429f-8a12-22dafd593d47 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:21.721517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb5be1-1c56-429f-8a12-22dafd593d47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:21.729958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb5be1-1c56-429f-8a12-22dafd593d47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:21.731590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb5be1-1c56-429f-8a12-22dafd593d47 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:21.740993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 713/1422] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:22.668713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260e74e-28c1-4c0f-9abc-320f0239b06f None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:22.669276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260e74e-28c1-4c0f-9abc-320f0239b06f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:22.669276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260e74e-28c1-4c0f-9abc-320f0239b06f None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:22.670632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:22.676898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f65f9-498d-4987-bdb7-0c9678eaa610 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:22.677340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f65f9-498d-4987-bdb7-0c9678eaa610 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:22.677431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f65f9-498d-4987-bdb7-0c9678eaa610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:22.705010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-9d0f65f9-498d-4987-bdb7-0c9678eaa610 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:22.706860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9d0f65f9-498d-4987-bdb7-0c9678eaa610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:22.716261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:22.866096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260e74e-28c1-4c0f-9abc-320f0239b06f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:22.884051 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260e74e-28c1-4c0f-9abc-320f0239b06f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:22.890440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589256a-c4c2-425e-bca1-6223ec4f0d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:22.891089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589256a-c4c2-425e-bca1-6223ec4f0d48 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:22.891405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589256a-c4c2-425e-bca1-6223ec4f0d48 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:22.891680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589256a-c4c2-425e-bca1-6223ec4f0d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:22.901440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589256a-c4c2-425e-bca1-6223ec4f0d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:22.904073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589256a-c4c2-425e-bca1-6223ec4f0d48 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:22.920441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 711/1425] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:23.834852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80b2-7292-43d7-ab67-f71c2681c01b None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:23.835495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80b2-7292-43d7-ab67-f71c2681c01b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:23.835495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f80b2-7292-43d7-ab67-f71c2681c01b None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:23.836835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:23.842186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6e94-6f23-4694-80c0-19bd6a420034 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:23.842614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6e94-6f23-4694-80c0-19bd6a420034 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:23.842728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6e94-6f23-4694-80c0-19bd6a420034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:23.861304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-4ccc6e94-6f23-4694-80c0-19bd6a420034 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:23.862493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4ccc6e94-6f23-4694-80c0-19bd6a420034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:23.871377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:24.024766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80b2-7292-43d7-ab67-f71c2681c01b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:24.042739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f80b2-7292-43d7-ab67-f71c2681c01b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:24.051549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d9479-cc37-4ae9-9ad6-341c143b831f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:24.052187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d9479-cc37-4ae9-9ad6-341c143b831f service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:24.052470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d9479-cc37-4ae9-9ad6-341c143b831f service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:24.052747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d9479-cc37-4ae9-9ad6-341c143b831f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:24.061322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d9479-cc37-4ae9-9ad6-341c143b831f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:24.062936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d9479-cc37-4ae9-9ad6-341c143b831f service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:24.073113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 716/1428] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:24.927347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853bb2-ff11-44f4-a83d-1c1ebbf4afc6 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:24.927986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853bb2-ff11-44f4-a83d-1c1ebbf4afc6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:24.927986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29853bb2-ff11-44f4-a83d-1c1ebbf4afc6 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:24.929270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:24.935541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ca1e2-e82e-41d9-bf75-1bee45025b1b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:24.936286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ca1e2-e82e-41d9-bf75-1bee45025b1b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:24.936424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ca1e2-e82e-41d9-bf75-1bee45025b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:24.963676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2f6ca1e2-e82e-41d9-bf75-1bee45025b1b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:24.964874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2f6ca1e2-e82e-41d9-bf75-1bee45025b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:24.973450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:25.134793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29853bb2-ff11-44f4-a83d-1c1ebbf4afc6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:25.151443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29853bb2-ff11-44f4-a83d-1c1ebbf4afc6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:25.157429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70224fc8-aa9c-4646-a998-1969d4457ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:25.158057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224fc8-aa9c-4646-a998-1969d4457ff8 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:25.158341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224fc8-aa9c-4646-a998-1969d4457ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:25.158612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70224fc8-aa9c-4646-a998-1969d4457ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:25.167732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70224fc8-aa9c-4646-a998-1969d4457ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:25.169320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70224fc8-aa9c-4646-a998-1969d4457ff8 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:25.180972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 714/1431] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:26.022218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469ebfc-75d1-469f-afca-3870f70c4797 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:26.022781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469ebfc-75d1-469f-afca-3870f70c4797 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:26.022984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469ebfc-75d1-469f-afca-3870f70c4797 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:26.025050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:26.034139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda944d-00be-4d3e-935c-1a73ce100382 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:26.034585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda944d-00be-4d3e-935c-1a73ce100382 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:26.034718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda944d-00be-4d3e-935c-1a73ce100382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:26.054457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8bda944d-00be-4d3e-935c-1a73ce100382 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:26.055703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8bda944d-00be-4d3e-935c-1a73ce100382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:26.065263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:26.217090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469ebfc-75d1-469f-afca-3870f70c4797 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:26.242434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469ebfc-75d1-469f-afca-3870f70c4797 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:26.250672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233d8c7-4862-4e49-94a7-f92d4f28985e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:26.251659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d8c7-4862-4e49-94a7-f92d4f28985e service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:26.251940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d8c7-4862-4e49-94a7-f92d4f28985e service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:26.252214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233d8c7-4862-4e49-94a7-f92d4f28985e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:26.263586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233d8c7-4862-4e49-94a7-f92d4f28985e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:26.265180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233d8c7-4862-4e49-94a7-f92d4f28985e service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:26.275838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 719/1434] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:27.120436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff395-2239-4d7c-bef1-cb47859bc4b5 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:27.120963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff395-2239-4d7c-bef1-cb47859bc4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:27.120963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff395-2239-4d7c-bef1-cb47859bc4b5 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:27.122416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:27.128488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbac55-dfc6-4ebf-8713-fbdba5b33104 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:27.128948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbac55-dfc6-4ebf-8713-fbdba5b33104 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:27.129058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbac55-dfc6-4ebf-8713-fbdba5b33104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:27.148554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1ffbac55-dfc6-4ebf-8713-fbdba5b33104 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:27.149736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1ffbac55-dfc6-4ebf-8713-fbdba5b33104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:27.158962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:27.316301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ff395-2239-4d7c-bef1-cb47859bc4b5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:27.338120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ff395-2239-4d7c-bef1-cb47859bc4b5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:27.344489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2d701-da94-4456-ab6b-798a6b76d7d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:27.345148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2d701-da94-4456-ab6b-798a6b76d7d0 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:27.345435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2d701-da94-4456-ab6b-798a6b76d7d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:27.345736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2d701-da94-4456-ab6b-798a6b76d7d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:27.354686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2d701-da94-4456-ab6b-798a6b76d7d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:27.356350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2d701-da94-4456-ab6b-798a6b76d7d0 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:27.366301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 717/1437] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:28.216396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c35ff-c8b4-4f17-b250-a3764c8a27a6 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:28.216926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c35ff-c8b4-4f17-b250-a3764c8a27a6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:28.217030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c35ff-c8b4-4f17-b250-a3764c8a27a6 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:28.218592 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:28.225541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca42b2d-3e8e-4606-83ca-41cbeee1d08c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:28.226044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca42b2d-3e8e-4606-83ca-41cbeee1d08c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:28.226136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca42b2d-3e8e-4606-83ca-41cbeee1d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:28.248622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0ca42b2d-3e8e-4606-83ca-41cbeee1d08c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:28.249807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0ca42b2d-3e8e-4606-83ca-41cbeee1d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:28.257926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:28.405958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c35ff-c8b4-4f17-b250-a3764c8a27a6 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:28.422098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c35ff-c8b4-4f17-b250-a3764c8a27a6 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:28.428743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c79c7-ba4b-458e-bded-fec885a2c0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:28.429386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c79c7-ba4b-458e-bded-fec885a2c0a7 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:28.429727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c79c7-ba4b-458e-bded-fec885a2c0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:28.430001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c79c7-ba4b-458e-bded-fec885a2c0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:28.439252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c79c7-ba4b-458e-bded-fec885a2c0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:28.440839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c79c7-ba4b-458e-bded-fec885a2c0a7 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:28.450485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 722/1440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:30.508753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0158-faf4-4f86-8c46-d55f1221c6b7 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:30.509583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0158-faf4-4f86-8c46-d55f1221c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:30.509676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b0158-faf4-4f86-8c46-d55f1221c6b7 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:30.511253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:30.518132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2065-d73e-4da5-81ed-8c0a40454a30 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:30.518590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2065-d73e-4da5-81ed-8c0a40454a30 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:30.518702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2065-d73e-4da5-81ed-8c0a40454a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:30.536883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ad1a2065-d73e-4da5-81ed-8c0a40454a30 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:30.538063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ad1a2065-d73e-4da5-81ed-8c0a40454a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:30.546298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:10:30.587416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0158-faf4-4f86-8c46-d55f1221c6b7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:30.599134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b0158-faf4-4f86-8c46-d55f1221c6b7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:30.603065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba862e-0d69-4be0-8f30-45d085fb8d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:30.603727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba862e-0d69-4be0-8f30-45d085fb8d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:30.604000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba862e-0d69-4be0-8f30-45d085fb8d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:30.604270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba862e-0d69-4be0-8f30-45d085fb8d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:30.613489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba862e-0d69-4be0-8f30-45d085fb8d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:30.614927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba862e-0d69-4be0-8f30-45d085fb8d76 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:30.624234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 720/1443] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:10:33.060281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3df55-5cc7-47ea-b90e-c5d1fe6e1e7c None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:33.061191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3df55-5cc7-47ea-b90e-c5d1fe6e1e7c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:33.061191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3df55-5cc7-47ea-b90e-c5d1fe6e1e7c None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:33.063429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:33.071548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa695-9004-42fa-9ff8-8331980373a7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:33.071548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa695-9004-42fa-9ff8-8331980373a7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:33.072042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfa695-9004-42fa-9ff8-8331980373a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:33.090549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5cdfa695-9004-42fa-9ff8-8331980373a7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:33.091767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5cdfa695-9004-42fa-9ff8-8331980373a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:33.100507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:33.142067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3df55-5cc7-47ea-b90e-c5d1fe6e1e7c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:33.153976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3df55-5cc7-47ea-b90e-c5d1fe6e1e7c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:33.157920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6355b-440d-4469-9e4d-fb9ccc81ff6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:33.158553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6355b-440d-4469-9e4d-fb9ccc81ff6d service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:33.158834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6355b-440d-4469-9e4d-fb9ccc81ff6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:33.159104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6355b-440d-4469-9e4d-fb9ccc81ff6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:33.169012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6355b-440d-4469-9e4d-fb9ccc81ff6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:33.170461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6355b-440d-4469-9e4d-fb9ccc81ff6d service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:33.180120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 725/1446] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:35.714998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ff22f-657c-4651-981f-4a54c1ebc163 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:35.715989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ff22f-657c-4651-981f-4a54c1ebc163 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:35.715989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ff22f-657c-4651-981f-4a54c1ebc163 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:35.718135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:35.726784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03df11-2f97-4298-bb13-38faee34d245 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:35.727255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03df11-2f97-4298-bb13-38faee34d245 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:35.727390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03df11-2f97-4298-bb13-38faee34d245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:35.749953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7d03df11-2f97-4298-bb13-38faee34d245 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:35.751169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7d03df11-2f97-4298-bb13-38faee34d245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:35.761387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:10:35.803067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ff22f-657c-4651-981f-4a54c1ebc163 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:35.820221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ff22f-657c-4651-981f-4a54c1ebc163 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:35.824336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da53288-fe90-40e8-968a-63096dffb93f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:35.824980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da53288-fe90-40e8-968a-63096dffb93f service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:35.825250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da53288-fe90-40e8-968a-63096dffb93f service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:35.825516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da53288-fe90-40e8-968a-63096dffb93f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:35.835487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da53288-fe90-40e8-968a-63096dffb93f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:35.836942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da53288-fe90-40e8-968a-63096dffb93f service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:35.846548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 723/1449] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:10:38.173346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401745b-eda7-4e79-9ff9-f08a012f0d74 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:38.174295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401745b-eda7-4e79-9ff9-f08a012f0d74 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:38.174295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401745b-eda7-4e79-9ff9-f08a012f0d74 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:38.176534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:38.185103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7448f-7b20-4d50-89d8-8a33ee19d60b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:38.185573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7448f-7b20-4d50-89d8-8a33ee19d60b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:38.185679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7448f-7b20-4d50-89d8-8a33ee19d60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:38.204424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-07a7448f-7b20-4d50-89d8-8a33ee19d60b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:38.205617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-07a7448f-7b20-4d50-89d8-8a33ee19d60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:38.214759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:38.255109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401745b-eda7-4e79-9ff9-f08a012f0d74 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:38.256957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1401745b-eda7-4e79-9ff9-f08a012f0d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:38.271490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401745b-eda7-4e79-9ff9-f08a012f0d74 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:38.276081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aefb887-72d6-4829-8a14-a2cd66009c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:38.276724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefb887-72d6-4829-8a14-a2cd66009c8d service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:38.277010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefb887-72d6-4829-8a14-a2cd66009c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:38.277269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aefb887-72d6-4829-8a14-a2cd66009c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:38.287054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefb887-72d6-4829-8a14-a2cd66009c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:38.288521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aefb887-72d6-4829-8a14-a2cd66009c8d service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:38.299146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 728/1452] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:40.649720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdbfc8-d6f8-4871-87d8-fce9ad8ed63e None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:40.650296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdbfc8-d6f8-4871-87d8-fce9ad8ed63e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:40.650296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdbfc8-d6f8-4871-87d8-fce9ad8ed63e None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:40.652396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:40.661669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340686-f286-48ba-8f8c-b4058b9c34dd None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:40.662095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340686-f286-48ba-8f8c-b4058b9c34dd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:40.662255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340686-f286-48ba-8f8c-b4058b9c34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:40.689399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1a340686-f286-48ba-8f8c-b4058b9c34dd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:40.690580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1a340686-f286-48ba-8f8c-b4058b9c34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:40.700281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:40.750623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdbfc8-d6f8-4871-87d8-fce9ad8ed63e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:40.763315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdbfc8-d6f8-4871-87d8-fce9ad8ed63e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:40.767666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4496608-a563-4ea4-a1e3-12e39fd8a594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:40.768246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496608-a563-4ea4-a1e3-12e39fd8a594 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:40.768537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496608-a563-4ea4-a1e3-12e39fd8a594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:40.768809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496608-a563-4ea4-a1e3-12e39fd8a594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:40.778591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4496608-a563-4ea4-a1e3-12e39fd8a594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:40.780069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4496608-a563-4ea4-a1e3-12e39fd8a594 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:40.789702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 726/1455] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:43.120150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a576e-488d-4b9c-b8fc-5db2dfae8bb3 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:43.120713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a576e-488d-4b9c-b8fc-5db2dfae8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:43.120713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a576e-488d-4b9c-b8fc-5db2dfae8bb3 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:43.122132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:43.128720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fed19a-29fb-4972-b5f7-0e1d96677571 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:43.129173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fed19a-29fb-4972-b5f7-0e1d96677571 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:43.129286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fed19a-29fb-4972-b5f7-0e1d96677571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:43.153985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d0fed19a-29fb-4972-b5f7-0e1d96677571 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:43.155192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d0fed19a-29fb-4972-b5f7-0e1d96677571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:43.164231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:43.202242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a576e-488d-4b9c-b8fc-5db2dfae8bb3 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:43.216171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a576e-488d-4b9c-b8fc-5db2dfae8bb3 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:43.221072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922a2f1-2416-4c80-90fc-25cb3948c036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:43.221692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922a2f1-2416-4c80-90fc-25cb3948c036 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:43.221979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922a2f1-2416-4c80-90fc-25cb3948c036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:43.222255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922a2f1-2416-4c80-90fc-25cb3948c036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:43.232049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922a2f1-2416-4c80-90fc-25cb3948c036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:43.233501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922a2f1-2416-4c80-90fc-25cb3948c036 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:43.243085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 731/1458] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:45.487591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6860b-d4c4-4c49-9c29-5916886dc301 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:45.488222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6860b-d4c4-4c49-9c29-5916886dc301 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:45.488222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6860b-d4c4-4c49-9c29-5916886dc301 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:45.489525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:45.495933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba00a7-6a71-4615-920e-3a5eeb318c33 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:45.496636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba00a7-6a71-4615-920e-3a5eeb318c33 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:45.496748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba00a7-6a71-4615-920e-3a5eeb318c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:45.504085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=70 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:45.520309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-76ba00a7-6a71-4615-920e-3a5eeb318c33 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:45.521493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-76ba00a7-6a71-4615-920e-3a5eeb318c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:45.530282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:45.568682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6860b-d4c4-4c49-9c29-5916886dc301 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:45.578030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=73 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:10:45.588210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6860b-d4c4-4c49-9c29-5916886dc301 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:45.592182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5ea5-abca-495c-bd90-df0789bd83d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:45.592810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5ea5-abca-495c-bd90-df0789bd83d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:45.593087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5ea5-abca-495c-bd90-df0789bd83d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:45.593355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5ea5-abca-495c-bd90-df0789bd83d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:45.603193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f5ea5-abca-495c-bd90-df0789bd83d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:45.604638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f5ea5-abca-495c-bd90-df0789bd83d4 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:45.614404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 729/1461] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:47.857701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350865a7-7400-463b-b316-e7bc7f9f786f None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:47.858325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350865a7-7400-463b-b316-e7bc7f9f786f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:47.858325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350865a7-7400-463b-b316-e7bc7f9f786f None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:47.859681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:47.866177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26975e5-3077-4ff1-9603-1bf916712ec3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:47.866636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26975e5-3077-4ff1-9603-1bf916712ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:47.866929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26975e5-3077-4ff1-9603-1bf916712ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:47.889736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c26975e5-3077-4ff1-9603-1bf916712ec3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:47.890942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c26975e5-3077-4ff1-9603-1bf916712ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:47.900217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:47.938436 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350865a7-7400-463b-b316-e7bc7f9f786f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:47.951517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350865a7-7400-463b-b316-e7bc7f9f786f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:47.955254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8563946-cbf0-4012-aad3-c978a1a5c58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:47.955884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563946-cbf0-4012-aad3-c978a1a5c58d service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:47.956163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563946-cbf0-4012-aad3-c978a1a5c58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:47.956425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563946-cbf0-4012-aad3-c978a1a5c58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:47.965758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8563946-cbf0-4012-aad3-c978a1a5c58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:47.967188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8563946-cbf0-4012-aad3-c978a1a5c58d service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:47.977008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 734/1464] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:50.211806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e737d-f002-42d0-9326-0d517107a185 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:50.212399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e737d-f002-42d0-9326-0d517107a185 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:50.212399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e737d-f002-42d0-9326-0d517107a185 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:50.214546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:50.223819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3af-2532-4c82-9926-01b4d00b50db None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:50.224310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3af-2532-4c82-9926-01b4d00b50db None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:50.224486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4d3af-2532-4c82-9926-01b4d00b50db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:50.243809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7bd4d3af-2532-4c82-9926-01b4d00b50db None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:50.245016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7bd4d3af-2532-4c82-9926-01b4d00b50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:50.253342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:50.291390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e737d-f002-42d0-9326-0d517107a185 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:50.310629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e737d-f002-42d0-9326-0d517107a185 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:50.317743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63beb410-7a1c-4126-9a77-afec1b19802f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:50.318687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beb410-7a1c-4126-9a77-afec1b19802f service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:50.318970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beb410-7a1c-4126-9a77-afec1b19802f service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:50.319279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63beb410-7a1c-4126-9a77-afec1b19802f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:50.328900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63beb410-7a1c-4126-9a77-afec1b19802f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:50.330357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63beb410-7a1c-4126-9a77-afec1b19802f service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:50.340494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 732/1467] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:10:52.506573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a3d8-b097-4648-91aa-8e8e35df1626 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:52.507498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a3d8-b097-4648-91aa-8e8e35df1626 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:52.507498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a3d8-b097-4648-91aa-8e8e35df1626 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:52.509461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:10:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:10:52.518565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f21d-8ff6-43cb-ada5-e7d883aeb0e9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:52.519307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f21d-8ff6-43cb-ada5-e7d883aeb0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:52.519497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35f21d-8ff6-43cb-ada5-e7d883aeb0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:52.547457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eb35f21d-8ff6-43cb-ada5-e7d883aeb0e9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:10:52.548902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eb35f21d-8ff6-43cb-ada5-e7d883aeb0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:10:52.559102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:10:52.599822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a3d8-b097-4648-91aa-8e8e35df1626 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:10:52.616540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a3d8-b097-4648-91aa-8e8e35df1626 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:10:52.620385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af4217-9554-491e-bf83-8b73aa9cdbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:10:52.621029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af4217-9554-491e-bf83-8b73aa9cdbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:10:52.621309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af4217-9554-491e-bf83-8b73aa9cdbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:10:52.621584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af4217-9554-491e-bf83-8b73aa9cdbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:10:52.631220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af4217-9554-491e-bf83-8b73aa9cdbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:10:52.632689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af4217-9554-491e-bf83-8b73aa9cdbe3 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:10:52.642284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 737/1470] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:11:02.540993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=17 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:02.638058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=17 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:25.372587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2bd76-48a4-44e2-990a-30de4bb0b4a6 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:25.373478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2bd76-48a4-44e2-990a-30de4bb0b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:25.373478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2bd76-48a4-44e2-990a-30de4bb0b4a6 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:25.375553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 734/1471] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:25.383277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f78ccd-65da-42da-8e87-20520e8d41ee None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:25.383706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f78ccd-65da-42da-8e87-20520e8d41ee None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:25.383831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f78ccd-65da-42da-8e87-20520e8d41ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:25.406179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-71f78ccd-65da-42da-8e87-20520e8d41ee None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:25.407933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-71f78ccd-65da-42da-8e87-20520e8d41ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:25.418618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 738/1472] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:25.470140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c5e7c-5b3d-4eed-b9c6-f4a53154ee25 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:25.470639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c5e7c-5b3d-4eed-b9c6-f4a53154ee25 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:25.471079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c5e7c-5b3d-4eed-b9c6-f4a53154ee25 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:25.473308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 735/1473] 10.222.0.45 () {54 vars in 962 bytes} [Wed May 25 16:11:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:25.478999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa7e9-16d2-4223-b86c-af7786230d1a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:25.479411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa7e9-16d2-4223-b86c-af7786230d1a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:25.479793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfa7e9-16d2-4223-b86c-af7786230d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:25.500210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-57dfa7e9-16d2-4223-b86c-af7786230d1a None None] MFA Rules not processed for user `096d124cc0484429858b2e5f6790ecb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:25.501426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-57dfa7e9-16d2-4223-b86c-af7786230d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:25.509399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 739/1474] 10.222.0.45 () {58 vars in 1059 bytes} [Wed May 25 16:11:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:25.520671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c5e7c-5b3d-4eed-b9c6-f4a53154ee25 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:25.535915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c5e7c-5b3d-4eed-b9c6-f4a53154ee25 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:25.540110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8db26-7b66-4b60-8e8e-dd7fecf829d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:25.540744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8db26-7b66-4b60-8e8e-dd7fecf829d4 service glance] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:25.541032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8db26-7b66-4b60-8e8e-dd7fecf829d4 service glance] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:25.541313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8db26-7b66-4b60-8e8e-dd7fecf829d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:25.550739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8db26-7b66-4b60-8e8e-dd7fecf829d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:25.552227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8db26-7b66-4b60-8e8e-dd7fecf829d4 service glance] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:25.561884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 736/1475] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:11:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:11:27.844809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125cab0-70e4-400b-8e11-a18221bb8c1e None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:27.845398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125cab0-70e4-400b-8e11-a18221bb8c1e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:27.845398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125cab0-70e4-400b-8e11-a18221bb8c1e None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:27.846998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 740/1476] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:27.852660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e6831-3dcb-4e32-9a84-31a68e56a6c9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:27.853136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e6831-3dcb-4e32-9a84-31a68e56a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:27.853231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e6831-3dcb-4e32-9a84-31a68e56a6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:27.872706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5a5e6831-3dcb-4e32-9a84-31a68e56a6c9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:27.873890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5a5e6831-3dcb-4e32-9a84-31a68e56a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:27.883818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 737/1477] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:11:27.910906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125cab0-70e4-400b-8e11-a18221bb8c1e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:27.929237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125cab0-70e4-400b-8e11-a18221bb8c1e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:27.934731 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:27.935471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:27.935749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:27.936016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:27.936744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:27.938540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:11:27.938540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:11:27.938540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:11:27.939741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3278e9b-759a-4141-8555-6f25131f6532 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:27.959536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 741/1478] 10.222.0.45 () {56 vars in 1108 bytes} [Wed May 25 16:11:27 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:11:30.196980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a762f-dee6-4409-ac3c-1d9ec50f6a60 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:30.197569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a762f-dee6-4409-ac3c-1d9ec50f6a60 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:30.197569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a762f-dee6-4409-ac3c-1d9ec50f6a60 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:30.198919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 738/1479] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:30.207814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2b4d-9928-4bb8-b7fc-96a53150a1df None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:30.208734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2b4d-9928-4bb8-b7fc-96a53150a1df None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:30.208734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2b4d-9928-4bb8-b7fc-96a53150a1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:30.228142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5f2c2b4d-9928-4bb8-b7fc-96a53150a1df None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:30.229273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5f2c2b4d-9928-4bb8-b7fc-96a53150a1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:30.238928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 742/1480] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:30.298051 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a762f-dee6-4409-ac3c-1d9ec50f6a60 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:30.314089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a762f-dee6-4409-ac3c-1d9ec50f6a60 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:30.320298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cb404-f328-409e-a756-06b6898f3916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:30.320939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cb404-f328-409e-a756-06b6898f3916 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:30.321216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cb404-f328-409e-a756-06b6898f3916 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:30.321491 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cb404-f328-409e-a756-06b6898f3916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:30.329965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cb404-f328-409e-a756-06b6898f3916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:30.331599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cb404-f328-409e-a756-06b6898f3916 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:30.341430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 739/1481] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:11:32.736528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763a686-2bc1-4229-bef8-d5bc357f4d7d None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:32.737070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763a686-2bc1-4229-bef8-d5bc357f4d7d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:32.737160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763a686-2bc1-4229-bef8-d5bc357f4d7d None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:32.739318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 743/1482] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:32.745701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03cae-2a96-479a-bed4-75036b30a52b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:32.746158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03cae-2a96-479a-bed4-75036b30a52b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:32.746259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03cae-2a96-479a-bed4-75036b30a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:32.768915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-62d03cae-2a96-479a-bed4-75036b30a52b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:32.770131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-62d03cae-2a96-479a-bed4-75036b30a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:32.779100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 740/1483] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:32.815662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763a686-2bc1-4229-bef8-d5bc357f4d7d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:32.828195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763a686-2bc1-4229-bef8-d5bc357f4d7d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:32.832886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca56a-a0ee-4de0-bb83-9bfdae04ebdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:32.833531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca56a-a0ee-4de0-bb83-9bfdae04ebdd service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:32.833811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca56a-a0ee-4de0-bb83-9bfdae04ebdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:32.834084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca56a-a0ee-4de0-bb83-9bfdae04ebdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:32.844227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca56a-a0ee-4de0-bb83-9bfdae04ebdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:32.845682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca56a-a0ee-4de0-bb83-9bfdae04ebdd service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:32.855328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 744/1484] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:11:35.105794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76895357-5649-4ce0-b259-e1eb05d5002b None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:35.106352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76895357-5649-4ce0-b259-e1eb05d5002b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:35.106352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76895357-5649-4ce0-b259-e1eb05d5002b None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:35.107771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 741/1485] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:35.113251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e983c-f5b7-41ef-b643-d80ed5b12127 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:35.113702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e983c-f5b7-41ef-b643-d80ed5b12127 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:35.113808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e983c-f5b7-41ef-b643-d80ed5b12127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:35.133491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a30e983c-f5b7-41ef-b643-d80ed5b12127 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:35.134684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a30e983c-f5b7-41ef-b643-d80ed5b12127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:35.143078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 745/1486] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:35.185521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76895357-5649-4ce0-b259-e1eb05d5002b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:35.201437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76895357-5649-4ce0-b259-e1eb05d5002b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:35.205904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7accf-6abc-44ec-9cb9-730e916305fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:35.206541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7accf-6abc-44ec-9cb9-730e916305fb service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:35.206819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7accf-6abc-44ec-9cb9-730e916305fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:35.207088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7accf-6abc-44ec-9cb9-730e916305fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:35.217691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7accf-6abc-44ec-9cb9-730e916305fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:35.219133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7accf-6abc-44ec-9cb9-730e916305fb service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:35.228981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 742/1487] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:11:37.542544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc789c-2885-444b-bad7-3084735d5511 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:37.543076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc789c-2885-444b-bad7-3084735d5511 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:37.543225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc789c-2885-444b-bad7-3084735d5511 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:37.545252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 746/1488] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:37.553790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c8bb6-155b-4d43-b7a4-d54d097e3542 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:37.554216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c8bb6-155b-4d43-b7a4-d54d097e3542 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:37.554377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c8bb6-155b-4d43-b7a4-d54d097e3542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:37.574335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-512c8bb6-155b-4d43-b7a4-d54d097e3542 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:37.575575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-512c8bb6-155b-4d43-b7a4-d54d097e3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:37.585139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 743/1489] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:37.628079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc789c-2885-444b-bad7-3084735d5511 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:37.639745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc789c-2885-444b-bad7-3084735d5511 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:37.643950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b230f7-d521-4631-af94-f8744f5fb3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:37.644582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b230f7-d521-4631-af94-f8744f5fb3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:37.644868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b230f7-d521-4631-af94-f8744f5fb3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:37.645133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b230f7-d521-4631-af94-f8744f5fb3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:37.654428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b230f7-d521-4631-af94-f8744f5fb3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:37.655939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b230f7-d521-4631-af94-f8744f5fb3c5 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:37.665335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 747/1490] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:11:40.072602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b363e-44a8-46cd-a241-1aa9fd6b9044 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:40.073389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b363e-44a8-46cd-a241-1aa9fd6b9044 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:40.073559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b363e-44a8-46cd-a241-1aa9fd6b9044 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:40.076246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 744/1491] 10.222.0.45 () {54 vars in 926 bytes} [Wed May 25 16:11:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:11:40.084704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f52f0-a238-4ae5-8fa3-592ec7665d95 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:40.085173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f52f0-a238-4ae5-8fa3-592ec7665d95 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:40.085279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f52f0-a238-4ae5-8fa3-592ec7665d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:40.104305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-438f52f0-a238-4ae5-8fa3-592ec7665d95 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:11:40.105483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-438f52f0-a238-4ae5-8fa3-592ec7665d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:11:40.114398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 748/1492] 10.222.0.45 () {58 vars in 1023 bytes} [Wed May 25 16:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:11:40.157203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b363e-44a8-46cd-a241-1aa9fd6b9044 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:11:40.177210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b363e-44a8-46cd-a241-1aa9fd6b9044 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:11:40.181881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8487cd-ce76-4bd0-ae59-12ead63055aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:11:40.182524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8487cd-ce76-4bd0-ae59-12ead63055aa service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:11:40.182804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8487cd-ce76-4bd0-ae59-12ead63055aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:11:40.183077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8487cd-ce76-4bd0-ae59-12ead63055aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:11:40.193197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8487cd-ce76-4bd0-ae59-12ead63055aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:11:40.194659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8487cd-ce76-4bd0-ae59-12ead63055aa service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:11:40.204626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 745/1493] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:11:50.098693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=33 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:11:50.200055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=33 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:21.587968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.588572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.588572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.612445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:13:21.613656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:21.626795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 749/1494] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:13:21.637514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.638058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.638058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.665919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:13:21.667573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:21.680894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 746/1495] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:13:21.686851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:21.700594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149400f-8bd4-4510-819e-db099e507d77 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:21.705251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:21.705927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.706208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.706496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.707227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:13:21.707516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:21.708541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:21.708541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:13:21.708541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:13:21.709420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:21.722635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 750/1496] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:13:21.732230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:21.745867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dccca8-3121-47b5-b997-5cd53f85af32 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:21.751275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:21.751934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.752218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.752490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.753185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:21.754981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:21.754981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:13:21.754981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:13:21.756243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:21.797413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 747/1497] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:13:21.803680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:21.813680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c8121-4e7e-4fb8-9734-f9d6c57a1898 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:21.872373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:21.872992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.873268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.873536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.874238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:21.875295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:21.875295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:13:21.875295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:13:21.876530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:21.899368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 751/1498] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:13:21 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:13:21.904774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:21.915208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d55305-407c-411f-8d01-e122b43c86b3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:21.920215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:21.920877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.921155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.921422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.922145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:21.923178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:21.923178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:13:21.923178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:13:21.924074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:21.937413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 748/1499] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:13:21.941594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:21.951875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ef85-acbb-4829-a6e6-5886714cff3e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:21.958119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:21.959110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.959495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.959835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:21.960621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:21.961649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:21.961649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:13:21.961649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:13:21.962588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5c6d1-7333-444a-9a19-57e25f649cf3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:21.977169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 752/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:13:21.981228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:21.991532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f32efc-daba-4349-9255-e1384830a2a0 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:21.996732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:21.997613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:21.997887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:21.998153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] PATH_INFO: `/v3/projects/56076a6b42d84a4ba610ef2a81ec8b20/users/275b420fc8b54e818054032bcd36623c/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.013501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56076a6b42d84a4ba610ef2a81ec8b20, user_id=275b420fc8b54e818054032bcd36623c, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:22.014511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:22.014511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:13:22.014511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:13:22.016493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565dad1-aba1-485a-b447-b4afef08a27a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:22.033285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 749/1501] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:13:21 2022] PUT /identity/v3/projects/56076a6b42d84a4ba610ef2a81ec8b20/users/275b420fc8b54e818054032bcd36623c/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:13:22.050081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8844-188e-40f1-b878-315dd829ce31 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.050370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8844-188e-40f1-b878-315dd829ce31 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.050647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8844-188e-40f1-b878-315dd829ce31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.077937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-91be8844-188e-40f1-b878-315dd829ce31 None None] MFA Rules not processed for user `275b420fc8b54e818054032bcd36623c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:13:22.079133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-91be8844-188e-40f1-b878-315dd829ce31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:22.160371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 753/1502] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:13:22.178000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33d3d2-4848-4f74-972d-998733f32be5 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.178285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33d3d2-4848-4f74-972d-998733f32be5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.178603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33d3d2-4848-4f74-972d-998733f32be5 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.180044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 750/1503] 10.222.0.45 () {54 vars in 963 bytes} [Wed May 25 16:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:13:22.185172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422fcd-8b94-4af4-8fe0-f6944b895831 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.185598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422fcd-8b94-4af4-8fe0-f6944b895831 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.185879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422fcd-8b94-4af4-8fe0-f6944b895831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.206278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-37422fcd-8b94-4af4-8fe0-f6944b895831 None None] MFA Rules not processed for user `9eb3714586bf4b50a1a9b29358f92b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:13:22.207523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-37422fcd-8b94-4af4-8fe0-f6944b895831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:22.252724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:22.262292 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 754/1504] 10.222.0.45 () {58 vars in 1060 bytes} [Wed May 25 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:13:22.270264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33d3d2-4848-4f74-972d-998733f32be5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:22.281661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33d3d2-4848-4f74-972d-998733f32be5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:22.285366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:22.285995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.286278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.286543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.295671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:22.297138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:22.305892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 751/1505] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:13:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:13:22.349037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1d89-4152-4497-b45e-f525b57936cf None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.349316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1d89-4152-4497-b45e-f525b57936cf None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.349594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e1d89-4152-4497-b45e-f525b57936cf None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.351115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 755/1506] 10.222.0.45 () {52 vars in 829 bytes} [Wed May 25 16:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:13:22.354948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:22.422616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a09be-398e-4d87-b261-d231429d03bc service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:22.427816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:22.428714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.428983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.429255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] PATH_INFO: `/v3/users/275b420fc8b54e818054032bcd36623c` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.430503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275b420fc8b54e818054032bcd36623c)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:22.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:22.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:13:22.431566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:13:22.432805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:22.499306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275b420fc8b54e818054032bcd36623c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:22.509711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275b420fc8b54e818054032bcd36623c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:22.510423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275b420fc8b54e818054032bcd36623c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:22.511245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275b420fc8b54e818054032bcd36623c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:22.531257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275b420fc8b54e818054032bcd36623c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:22.540229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:22.554942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 752/1507] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:13:22 2022] DELETE /identity/v3/users/275b420fc8b54e818054032bcd36623c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:13:22.559479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234c83-f229-46f8-b908-60470b2890db None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.559772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234c83-f229-46f8-b908-60470b2890db None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.560054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234c83-f229-46f8-b908-60470b2890db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.580593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-20234c83-f229-46f8-b908-60470b2890db None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:13:22.582196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-20234c83-f229-46f8-b908-60470b2890db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:22.648813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 756/1508] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:13:22.660729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:22.662675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:22.730192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d6847-a638-4d1f-a09d-f9332be0c6d7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:22.734163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765ffd5-5a51-4730-b7f0-910579351ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:22.734816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ffd5-5a51-4730-b7f0-910579351ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:22.735095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ffd5-5a51-4730-b7f0-910579351ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:22.735392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765ffd5-5a51-4730-b7f0-910579351ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:22.744946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ffd5-5a51-4730-b7f0-910579351ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:22.746417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765ffd5-5a51-4730-b7f0-910579351ba7 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:22.756062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 753/1509] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:13:23.160450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234c83-f229-46f8-b908-60470b2890db None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:13:23.162210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-20234c83-f229-46f8-b908-60470b2890db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:13:23.175752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234c83-f229-46f8-b908-60470b2890db None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:13:23.183353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:13:23.184207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:13:23.184516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:13:23.184790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] PATH_INFO: `/v3/projects/56076a6b42d84a4ba610ef2a81ec8b20` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:13:23.187081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56076a6b42d84a4ba610ef2a81ec8b20)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:13:23.188162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:13:23.188162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:13:23.188162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:13:23.189407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:13:23.252390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56076a6b42d84a4ba610ef2a81ec8b20', 'request_id': 'req-7eca9b0b-c33c-41a0-b075-6eb6f566af19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:23.265795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56076a6b42d84a4ba610ef2a81ec8b20', 'request_id': 'req-7eca9b0b-c33c-41a0-b075-6eb6f566af19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:23.272273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56076a6b42d84a4ba610ef2a81ec8b20', 'request_id': 'req-7eca9b0b-c33c-41a0-b075-6eb6f566af19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:23.287394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] The token cache is being invalidate because project 56076a6b42d84a4ba610ef2a81ec8b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:13:23.287685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:23.288333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7eca9b0b-c33c-41a0-b075-6eb6f566af19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:13:23.289997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 757/1510] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:13:23 2022] DELETE /identity/v3/projects/56076a6b42d84a4ba610ef2a81ec8b20 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:13:32.751711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=29 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:13:33.284323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:04.059363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26b137-f4a2-4d8b-96b1-07afd66b3a23 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:04.059993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26b137-f4a2-4d8b-96b1-07afd66b3a23 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:04.059993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26b137-f4a2-4d8b-96b1-07afd66b3a23 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:04.062108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:15:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:04.067532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978192-0488-4d8a-90ca-87b00a981c87 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:04.068010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978192-0488-4d8a-90ca-87b00a981c87 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:04.068094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978192-0488-4d8a-90ca-87b00a981c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:04.088083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8f978192-0488-4d8a-90ca-87b00a981c87 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:04.089299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8f978192-0488-4d8a-90ca-87b00a981c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:04.152841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:04.320783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26b137-f4a2-4d8b-96b1-07afd66b3a23 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:04.324133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-af26b137-f4a2-4d8b-96b1-07afd66b3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:04.407356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26b137-f4a2-4d8b-96b1-07afd66b3a23 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:04.413432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d8c65-9609-4726-80e8-c6169630bd22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:04.414088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8c65-9609-4726-80e8-c6169630bd22 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:04.414372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8c65-9609-4726-80e8-c6169630bd22 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:04.414645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8c65-9609-4726-80e8-c6169630bd22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:04.423366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d8c65-9609-4726-80e8-c6169630bd22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:04.425044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d8c65-9609-4726-80e8-c6169630bd22 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:04.434947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 755/1513] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:05.271574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac55b2-e291-4686-87b2-9fb3b7ef4114 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:05.272210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac55b2-e291-4686-87b2-9fb3b7ef4114 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:05.272210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac55b2-e291-4686-87b2-9fb3b7ef4114 None None] PATH_INFO: `/v3` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:05.273453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 759/1514] 10.222.0.78 () {54 vars in 925 bytes} [Wed May 25 16:15:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:15:05.280272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5c31-77f7-448a-8e43-35aa549bca24 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:05.280725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5c31-77f7-448a-8e43-35aa549bca24 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:05.280834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5c31-77f7-448a-8e43-35aa549bca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:05.301332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6fbb5c31-77f7-448a-8e43-35aa549bca24 None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:05.302562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6fbb5c31-77f7-448a-8e43-35aa549bca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:05.319240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72df896-99e8-40c8-935d-14225546a606 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:05.319486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72df896-99e8-40c8-935d-14225546a606 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:05.319764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72df896-99e8-40c8-935d-14225546a606 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:05.321164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 760/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:05.325942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:05.326230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:05.326510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:05.345439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:05.346666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:05.355312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 761/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:05.367070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 756/1517] 10.222.0.78 () {58 vars in 1015 bytes} [Wed May 25 16:15:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:05.507953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:05.521456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2baa9-4170-4d98-bb4e-7d68ba2996d4 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:05.528342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc2fc6-055f-4f02-93dd-ce6c3f4496b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:05.528988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc2fc6-055f-4f02-93dd-ce6c3f4496b4 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:05.529268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc2fc6-055f-4f02-93dd-ce6c3f4496b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:05.529546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc2fc6-055f-4f02-93dd-ce6c3f4496b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:05.538153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc2fc6-055f-4f02-93dd-ce6c3f4496b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:05.540670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc2fc6-055f-4f02-93dd-ce6c3f4496b4 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:05.552109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 762/1518] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:09.251913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d71ac6-8649-463e-b3b7-21a3dcc11b93 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:09.252719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d71ac6-8649-463e-b3b7-21a3dcc11b93 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:09.252896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d71ac6-8649-463e-b3b7-21a3dcc11b93 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:09.255100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 757/1519] 10.222.0.45 () {54 vars in 960 bytes} [Wed May 25 16:15:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:09.261137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb68e-5fab-411e-a4e8-c27ef6c64d90 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:09.261567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb68e-5fab-411e-a4e8-c27ef6c64d90 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:09.261672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9eb68e-5fab-411e-a4e8-c27ef6c64d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:09.281035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5b9eb68e-5fab-411e-a4e8-c27ef6c64d90 None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:09.282213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5b9eb68e-5fab-411e-a4e8-c27ef6c64d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:09.292536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 763/1520] 10.222.0.45 () {58 vars in 1057 bytes} [Wed May 25 16:15:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:09.300304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d71ac6-8649-463e-b3b7-21a3dcc11b93 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:09.314932 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d71ac6-8649-463e-b3b7-21a3dcc11b93 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:09.320829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8bc3-7cb5-4026-989d-9894d294ae6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:09.321398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8bc3-7cb5-4026-989d-9894d294ae6c service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:09.321680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8bc3-7cb5-4026-989d-9894d294ae6c service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:09.321948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8bc3-7cb5-4026-989d-9894d294ae6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:09.330402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8bc3-7cb5-4026-989d-9894d294ae6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:09.332209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8bc3-7cb5-4026-989d-9894d294ae6c service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:09.341749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 758/1521] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:15:16.861205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cb82f-e3b3-40f2-96e5-e45be12d4e15 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:16.862007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cb82f-e3b3-40f2-96e5-e45be12d4e15 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:16.862284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cb82f-e3b3-40f2-96e5-e45be12d4e15 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:16.865428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:15:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:15:16.873742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e170a-34a3-40c5-a5dd-644cd53cd188 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:16.874193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e170a-34a3-40c5-a5dd-644cd53cd188 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:16.874318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e170a-34a3-40c5-a5dd-644cd53cd188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:16.893499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8c3e170a-34a3-40c5-a5dd-644cd53cd188 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:16.894694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8c3e170a-34a3-40c5-a5dd-644cd53cd188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:16.903293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:17.063191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cb82f-e3b3-40f2-96e5-e45be12d4e15 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:17.082482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cb82f-e3b3-40f2-96e5-e45be12d4e15 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:17.088644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622770-070e-4e71-8108-bb11b57bb559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:17.089296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622770-070e-4e71-8108-bb11b57bb559 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:17.089594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622770-070e-4e71-8108-bb11b57bb559 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:17.089862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622770-070e-4e71-8108-bb11b57bb559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:17.098556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622770-070e-4e71-8108-bb11b57bb559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:17.100198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622770-070e-4e71-8108-bb11b57bb559 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:17.110908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 765/1524] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:17.986477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca72a-f3d8-4965-bbb1-b2dc2686ec36 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:17.987053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca72a-f3d8-4965-bbb1-b2dc2686ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:17.987053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ca72a-f3d8-4965-bbb1-b2dc2686ec36 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:17.988448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 16:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:17.994325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5103eb-a2b0-4a41-b394-b389ce73a337 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:17.995113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5103eb-a2b0-4a41-b394-b389ce73a337 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:17.995278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5103eb-a2b0-4a41-b394-b389ce73a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:18.021821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ad5103eb-a2b0-4a41-b394-b389ce73a337 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:18.023004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ad5103eb-a2b0-4a41-b394-b389ce73a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:18.031700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 16:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:18.184322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ca72a-f3d8-4965-bbb1-b2dc2686ec36 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:18.200825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ca72a-f3d8-4965-bbb1-b2dc2686ec36 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:18.207553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799a391-279a-40cc-97b6-ac868aa57662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:18.208190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a391-279a-40cc-97b6-ac868aa57662 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:18.208472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a391-279a-40cc-97b6-ac868aa57662 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:18.208748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799a391-279a-40cc-97b6-ac868aa57662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:18.217506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a391-279a-40cc-97b6-ac868aa57662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:18.219248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a799a391-279a-40cc-97b6-ac868aa57662 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:18.228458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 761/1527] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:15:22.395668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e68e5-b317-4427-afcb-286384cfabec None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:22.396552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e68e5-b317-4427-afcb-286384cfabec None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:22.396552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e68e5-b317-4427-afcb-286384cfabec None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:22.398579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:15:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:22.407323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50b5a-1e53-4e8d-8f55-afc9723d6452 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:22.407770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50b5a-1e53-4e8d-8f55-afc9723d6452 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:22.407898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea50b5a-1e53-4e8d-8f55-afc9723d6452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:22.433978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8ea50b5a-1e53-4e8d-8f55-afc9723d6452 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:22.435204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8ea50b5a-1e53-4e8d-8f55-afc9723d6452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:22.444294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:22.483050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e68e5-b317-4427-afcb-286384cfabec None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:22.485132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0f0e68e5-b317-4427-afcb-286384cfabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:22.547332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e68e5-b317-4427-afcb-286384cfabec None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:22.551790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e241e87-01ed-415e-89dc-708375267d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:22.552438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e241e87-01ed-415e-89dc-708375267d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:22.552719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e241e87-01ed-415e-89dc-708375267d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:22.552988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e241e87-01ed-415e-89dc-708375267d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:22.562674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e241e87-01ed-415e-89dc-708375267d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:22.564213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e241e87-01ed-415e-89dc-708375267d21 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:22.576823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 768/1530] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:24.782973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce793bc5-b2e1-49d7-afaa-7e197f3c56c0 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:24.783890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce793bc5-b2e1-49d7-afaa-7e197f3c56c0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:24.783890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce793bc5-b2e1-49d7-afaa-7e197f3c56c0 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:24.786108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:15:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:24.791625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365d93-951d-4646-a48e-f6e72b80819b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:24.792449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365d93-951d-4646-a48e-f6e72b80819b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:24.792558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365d93-951d-4646-a48e-f6e72b80819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:24.814294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-52365d93-951d-4646-a48e-f6e72b80819b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:24.815648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-52365d93-951d-4646-a48e-f6e72b80819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:24.825616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:24.868827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce793bc5-b2e1-49d7-afaa-7e197f3c56c0 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:24.882026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce793bc5-b2e1-49d7-afaa-7e197f3c56c0 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:24.885874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb80f03-253b-48c6-b531-2fb78b834ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:24.886535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb80f03-253b-48c6-b531-2fb78b834ccb service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:24.886816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb80f03-253b-48c6-b531-2fb78b834ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:24.887089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb80f03-253b-48c6-b531-2fb78b834ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:24.896454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb80f03-253b-48c6-b531-2fb78b834ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:24.897904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb80f03-253b-48c6-b531-2fb78b834ccb service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:24.907275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 764/1533] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:28.751469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb50ed-61c9-4318-9ece-55c6652ee545 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:28.752274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb50ed-61c9-4318-9ece-55c6652ee545 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:28.752274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb50ed-61c9-4318-9ece-55c6652ee545 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:28.754322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:15:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:28.759864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764bee4-d99f-4f81-92d6-5df9cf402f20 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:28.760357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764bee4-d99f-4f81-92d6-5df9cf402f20 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:28.760461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764bee4-d99f-4f81-92d6-5df9cf402f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:28.780988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0764bee4-d99f-4f81-92d6-5df9cf402f20 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:28.782192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0764bee4-d99f-4f81-92d6-5df9cf402f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:28.791147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:29.064025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb50ed-61c9-4318-9ece-55c6652ee545 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:29.067028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a5bb50ed-61c9-4318-9ece-55c6652ee545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:29.135270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb50ed-61c9-4318-9ece-55c6652ee545 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:29.139212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd887a3-9799-405c-993a-a62f077cf82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:29.139887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd887a3-9799-405c-993a-a62f077cf82e service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:29.140172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd887a3-9799-405c-993a-a62f077cf82e service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:29.140446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd887a3-9799-405c-993a-a62f077cf82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:29.146573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:29.150446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd887a3-9799-405c-993a-a62f077cf82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:29.152200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd887a3-9799-405c-993a-a62f077cf82e service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:29.161802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 771/1536] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:31.366561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd481-217a-4254-99a9-c3c19cae5c79 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:31.367383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd481-217a-4254-99a9-c3c19cae5c79 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:31.367383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd481-217a-4254-99a9-c3c19cae5c79 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:31.369533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 16:15:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:15:31.375488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0ed3-4f28-4d32-964f-1d4f9e47389c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:31.375895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0ed3-4f28-4d32-964f-1d4f9e47389c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:31.376092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a0ed3-4f28-4d32-964f-1d4f9e47389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:31.398655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a00a0ed3-4f28-4d32-964f-1d4f9e47389c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:15:31.399931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a00a0ed3-4f28-4d32-964f-1d4f9e47389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:31.409833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:15:31.677977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd481-217a-4254-99a9-c3c19cae5c79 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:15:31.681401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a41bd481-217a-4254-99a9-c3c19cae5c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:15:31.702023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd481-217a-4254-99a9-c3c19cae5c79 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:15:31.707436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e18db-d3aa-4913-bff1-3e0a9e89d305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:15:31.708082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e18db-d3aa-4913-bff1-3e0a9e89d305 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:15:31.708369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e18db-d3aa-4913-bff1-3e0a9e89d305 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:15:31.708743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e18db-d3aa-4913-bff1-3e0a9e89d305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:15:31.719755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e18db-d3aa-4913-bff1-3e0a9e89d305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:15:31.721235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e18db-d3aa-4913-bff1-3e0a9e89d305 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:15:31.731044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 767/1539] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:15:41.391813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:15:41.727079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=96 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:02.515739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.516879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.517390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.553769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:02.555408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:02.568483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 773/1540] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:02.579922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.580511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.580511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.610037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:02.611436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:02.630629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 768/1541] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:02.639033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:02.657297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be6877-97bd-4960-9f6b-c3f97c766429 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:02.665083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:02.666183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.667055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.667695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.668662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:02.669226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:02.673579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:02.689974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 774/1542] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:02.699585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:02.715087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c414-4196-4c4d-919f-267718388166 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:02.723835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b48e4-8582-4a07-b5db-fb655a8f2ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:02.724525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b48e4-8582-4a07-b5db-fb655a8f2ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.724812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b48e4-8582-4a07-b5db-fb655a8f2ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.725089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b48e4-8582-4a07-b5db-fb655a8f2ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.725793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b48e4-8582-4a07-b5db-fb655a8f2ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:02.727833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b48e4-8582-4a07-b5db-fb655a8f2ab3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:02.779768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 769/1543] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/projects => generated 355 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:02.784848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:02.799502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb1674-994a-4daf-8d28-5f4090fccb61 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:02.825079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a313e-9fc9-475e-a03c-3908629124d3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.825763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a313e-9fc9-475e-a03c-3908629124d3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.826298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a313e-9fc9-475e-a03c-3908629124d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.858905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0a2a313e-9fc9-475e-a03c-3908629124d3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:02.860761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0a2a313e-9fc9-475e-a03c-3908629124d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:02.891092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba07d1-db61-4821-be66-c8e36369c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:02.892136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba07d1-db61-4821-be66-c8e36369c04a admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.892679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba07d1-db61-4821-be66-c8e36369c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.893574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba07d1-db61-4821-be66-c8e36369c04a admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.894488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba07d1-db61-4821-be66-c8e36369c04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:02.896726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba07d1-db61-4821-be66-c8e36369c04a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:02.937107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 775/1544] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/users => generated 278 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:02.939330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.939789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.940366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.957530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 770/1545] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:02.960598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0beb64-79ef-4a52-860f-1cccc8120922 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.961138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0beb64-79ef-4a52-860f-1cccc8120922 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.961639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0beb64-79ef-4a52-860f-1cccc8120922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:02.969027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:02.970492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:02.979399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 776/1546] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:02.980432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:02.983385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6b0beb64-79ef-4a52-860f-1cccc8120922 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:02.984622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6b0beb64-79ef-4a52-860f-1cccc8120922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:02.991724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13ed40-0f9f-4e0d-a9b4-c6e7090dbce7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:02.993968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 771/1547] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:02.995606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e725f66-8f10-4428-a842-2ae23ae74d74 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:02.996071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e725f66-8f10-4428-a842-2ae23ae74d74 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:02.996623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e725f66-8f10-4428-a842-2ae23ae74d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.002916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b3a09-19c4-4b7f-8ba1-25070e164802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.003702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3a09-19c4-4b7f-8ba1-25070e164802 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.004185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3a09-19c4-4b7f-8ba1-25070e164802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.004745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b3a09-19c4-4b7f-8ba1-25070e164802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.005425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3a09-19c4-4b7f-8ba1-25070e164802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.007240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b3a09-19c4-4b7f-8ba1-25070e164802 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.020041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-2e725f66-8f10-4428-a842-2ae23ae74d74 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.021643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 777/1548] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:03.021883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2e725f66-8f10-4428-a842-2ae23ae74d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.029934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a8f8-7d46-4ca4-beeb-6dd61c0dc911 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.029934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a8f8-7d46-4ca4-beeb-6dd61c0dc911 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.029934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a8f8-7d46-4ca4-beeb-6dd61c0dc911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.038130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 772/1549] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.040043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19213061-776e-4439-a126-ed7fafd12b0f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.040633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19213061-776e-4439-a126-ed7fafd12b0f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.041062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19213061-776e-4439-a126-ed7fafd12b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.047919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ea79a8f8-7d46-4ca4-beeb-6dd61c0dc911 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.049266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ea79a8f8-7d46-4ca4-beeb-6dd61c0dc911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.057896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 778/1550] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.059210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.059501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.059778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.061159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-19213061-776e-4439-a126-ed7fafd12b0f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.062364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-19213061-776e-4439-a126-ed7fafd12b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.076222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 773/1551] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.077895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936adbd-6602-4c8d-a601-de4da181fac2 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.078370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936adbd-6602-4c8d-a601-de4da181fac2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.078837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936adbd-6602-4c8d-a601-de4da181fac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.080386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.081614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.090982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 779/1552] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.092381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.097300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3936adbd-6602-4c8d-a601-de4da181fac2 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.098591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3936adbd-6602-4c8d-a601-de4da181fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.101813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf3ed2-20f2-4389-b482-dff73f566e1d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.106243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f06a68-77c3-4c80-8317-2b6f6fb79e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.106427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 774/1553] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.106893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f06a68-77c3-4c80-8317-2b6f6fb79e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.107377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f06a68-77c3-4c80-8317-2b6f6fb79e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.107672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f06a68-77c3-4c80-8317-2b6f6fb79e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.107795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b71e9-94cd-45ff-bef4-808d75fa823b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.107950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b71e9-94cd-45ff-bef4-808d75fa823b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.108216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b71e9-94cd-45ff-bef4-808d75fa823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.108515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f06a68-77c3-4c80-8317-2b6f6fb79e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.110554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f06a68-77c3-4c80-8317-2b6f6fb79e96 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.120766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 780/1554] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:03.122068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a702-0572-442e-aea9-0fa7a5b793cd None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.122337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a702-0572-442e-aea9-0fa7a5b793cd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.122619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47a702-0572-442e-aea9-0fa7a5b793cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.126614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-4f0b71e9-94cd-45ff-bef4-808d75fa823b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.127842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4f0b71e9-94cd-45ff-bef4-808d75fa823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.135931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 775/1555] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.137181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.137598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.137880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.144698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-3c47a702-0572-442e-aea9-0fa7a5b793cd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.145938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3c47a702-0572-442e-aea9-0fa7a5b793cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.156553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 781/1556] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.157815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.158099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.158371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.161179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.162379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.171010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 776/1557] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.171853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.177559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.178772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.182451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea278281-b078-408f-a30a-20c8aec6abb5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.186682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 782/1558] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.186962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.187488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.187671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.187927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.188202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.188918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.189224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.190540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 16:17:03.190540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:17:03.190540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:17:03.191466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.196750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90da029-8659-4475-a0c1-8aa32822e945 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.201243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.201890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.202174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.202452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.203186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.203305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 777/1559] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.203505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.203980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.205125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.213189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdcb0-64d8-41b6-9c1a-38d3781d7c11 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.217895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.218370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.218671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.218947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.219685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.219991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.220834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 783/1560] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.221626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.224123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8deda-7a71-4435-b1af-225bd5dea18d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.231488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12f70-513b-441c-abfb-d1b06975e157 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.236342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.237111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 778/1561] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.237251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.239080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.239080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] PATH_INFO: `/v3/projects/f75ea0329b0f4e119fe5b03f974f01bc/users/bd038a81f4ec4e4899edc24676e110a6/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.239331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a30c-dbad-4e47-b286-5237c18fb4e7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.239331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a30c-dbad-4e47-b286-5237c18fb4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.239331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a30c-dbad-4e47-b286-5237c18fb4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.256896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3093a30c-dbad-4e47-b286-5237c18fb4e7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.258098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3093a30c-dbad-4e47-b286-5237c18fb4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.258484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75ea0329b0f4e119fe5b03f974f01bc, user_id=bd038a81f4ec4e4899edc24676e110a6, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.259584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:17:03.259584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:17:03.259584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:17:03.261557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.266382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 779/1562] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.267820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.268164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.268446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.276944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 784/1563] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:03 2022] PUT /identity/v3/projects/f75ea0329b0f4e119fe5b03f974f01bc/users/bd038a81f4ec4e4899edc24676e110a6/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:03.280064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.286946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.288188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.324630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:03.339425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:03.346666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac91361-ab04-452d-8609-4fd6e0bddf28 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.351294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 780/1564] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.351487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.352099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.352380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.352653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.353075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.353396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.353705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.355405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.362724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60663-8c89-4c84-95a9-b5e23c62f1eb None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.367331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 785/1565] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.368885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.369545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.369830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.370105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.370838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.371167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.372141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.372780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.382159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32015567-33a4-419f-84c9-d2990e9f6ff8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.385529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 781/1566] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.386395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.393573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.394316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.394592 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.394864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.395710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.396771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:17:03.396771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:17:03.396771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:17:03.397382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d2be-8a56-4edc-87dc-7cf63f244663 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.397987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.402068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.402708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.402990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.403318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.404002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.405886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.428970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 786/1567] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.428970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.433969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 782/1568] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.434862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.491035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aef03-9213-4079-800b-17dbad1fecf4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.495644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.496341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.496623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.496906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.497742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.498943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6c92-55b5-49b2-9b44-8c33d299bc2c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.499755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.503762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.504411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.504777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.505044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.505773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.506080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.507816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a1eb4-b942-4ca0-a23b-6427e093c1f6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.519729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 783/1569] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.521055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.521340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.521682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.527191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 787/1570] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.527191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.553778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] MFA Rules not processed for user `bd038a81f4ec4e4899edc24676e110a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:03.555415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:03.588430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65028252-7499-4c51-9f3b-547079f4523c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.594060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.594762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.595043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.595388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.596158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:03.596461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.598110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.621346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 788/1571] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:03.621346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.625220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 784/1572] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:03.626113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.626261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17db133-2502-4b79-94f6-f453575fa744 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.631342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.632010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.632295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.632571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.633266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.635214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.636361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435da01-d9ad-4456-8b91-fccf372d30a1 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.640782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.641422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.641711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.641984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.642669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.644588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.666218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 789/1573] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.666218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.672741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:03.676737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 785/1574] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.677430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.710181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:03.727065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17faff-d9ab-4dfd-9791-a41d739373c6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.743881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420bb16a-202b-4be4-84fa-0cce47f3b59a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.748477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.749156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.749439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.749712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.750401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.751487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:17:03.751487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:17:03.751487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:17:03.752687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.773576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 786/1575] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.774380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.784501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59cbc-1c18-4c30-b40e-168da7b76e5a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.786264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.786950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.787249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.787528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.788225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.789252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.789892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.790167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.790275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.790438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.791144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.793431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.810443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 790/1576] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.811507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.821534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ddb9a-a89b-4cc6-93b1-4b8210971c49 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.825333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 787/1577] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.825333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.886853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.888199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.888296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.888656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.889527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.891526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5faa6-558b-4267-ae07-0f2d510a5c24 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.891648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.896213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.896885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.897170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.897452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.898273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.900255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.914430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 791/1578] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.915284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.925877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845a70a-36a6-44e2-a5da-ac762c9d2dcb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:03.930849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:03.931529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:03.931875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:03.932078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:03.932764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:03.934681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:03.938276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 788/1579] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.938276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.966121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 792/1580] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:03.967382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:03.983340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:04.008520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76c0c9-2b06-47b0-adf3-468e67a6ebf3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.033032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:04.041749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c04a6-f61a-431a-b840-dda88a10ce30 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.046885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.047597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.047911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.048310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.049388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.051502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.068536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.069651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.069651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.069847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.070483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.072466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.077287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 793/1581] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:04.077287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.088338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57985e02-569e-45c9-8871-f62674721f68 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.093594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 789/1582] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:03 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:04.093714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.094412 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.094519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.094777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.094991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.095751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.097521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.103921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ca153-0050-495c-a522-25ee4a35dd41 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.108510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.108842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 794/1583] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.109167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.109446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.109621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.109724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.110430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.112140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.118938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0770229-c7ee-4f0b-b7f7-f83cc44cc6dc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.122511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 790/1584] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.123447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.123579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.124095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.124375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.124665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.125339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.127544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.134559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f89977-d2e8-43dc-9644-85ae9d522f8c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.141432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.142199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.142505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.142776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.143591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.145616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.149514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 795/1585] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/users => generated 294 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:04.150303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.156112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 791/1586] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.156908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.159987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e74498-4733-4c33-82d7-b3028f8281e8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.164698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.165355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.165637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.165913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.166395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe96b4-c246-4f5c-804f-5f4c7e6ae744 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.166969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.168951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.171260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.171897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.172176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.172453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.173151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.175038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.195559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 796/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:04.195559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.201712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 792/1588] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:04.202495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.205543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf0807-7fea-47f5-8e0c-f2a406dfcc5c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.210313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.210965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.211278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.211540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.212182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148d05d-ef4a-42da-bf99-96636d203f7c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.212308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.213871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.217194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.217833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.218110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.218382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.219127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.220740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.224309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 797/1589] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.225099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.231060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 793/1590] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.232007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.234828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598ef10-f859-4741-84d0-01765a41a597 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.240214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.240878 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.241202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.241480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.242199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.242436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253ae7c-9bd7-4879-a655-e40697cc7c59 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.243918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.247377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.248043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.248335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.248706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.249324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.250902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.255660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 798/1591] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.256230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.261688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 794/1592] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.262665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.268200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1eb2a-41e8-44ce-9f9c-20fe34f2e5cc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.272416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb33e7-9644-40fb-893e-dfc6ffefdefe admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.273365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.274221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.274508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.274781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.275551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.277072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.277206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.277708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.277992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.278265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.278969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.280588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.288143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 799/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.288865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.294305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 795/1594] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.294305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.299499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d7e60-df0f-4a1a-b677-4b4275066bd4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.301938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3f6a-9282-4f7e-8a3d-0847a2d0ae23 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.305057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.305818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.306105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.306381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.306510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.307083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.307230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.307405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.307681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.308393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.309428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.309975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.320032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 800/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.323787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 796/1596] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.323787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.324614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.331209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5345385-fd20-4cba-be6c-ee8f224d0747 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.334420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68deff-3426-49d4-8f28-5794c3721819 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.335913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.336551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.336835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.337110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.337847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.339482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.339752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.340477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.340765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.341070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.341805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.343448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.350840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 797/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.351584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.356681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 801/1598] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.356681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.363544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b491d-5936-4fcf-b80f-c58b877ba8f1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.363892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5b1d3-2bcc-40d1-8517-9710b5c98de6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.368452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.369084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.369321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.369607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.369884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] PATH_INFO: `/v3/projects/c3003077416c4ce997e3aa7e47e8e3b7/users/06ba885a0b164134898c42a332feba76/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.370035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.370292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.370563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] PATH_INFO: `/v3/projects/b36e59bfe72a49679b3b3657f5a65882/users/e4e4d39c5ed249bc9dc097ba4c24b3d2/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.386612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3003077416c4ce997e3aa7e47e8e3b7, user_id=06ba885a0b164134898c42a332feba76, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.387509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36e59bfe72a49679b3b3657f5a65882, user_id=e4e4d39c5ed249bc9dc097ba4c24b3d2, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.389392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.390493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.404503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 802/1599] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/c3003077416c4ce997e3aa7e47e8e3b7/users/06ba885a0b164134898c42a332feba76/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.408249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.408360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 798/1600] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/b36e59bfe72a49679b3b3657f5a65882/users/e4e4d39c5ed249bc9dc097ba4c24b3d2/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.408360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.447250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:04.469168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:04.472546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e119a1-2806-45ad-9349-7d9965acc557 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.473230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738c7de6-e72d-4fd7-a2e9-09cd646995e6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.477745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.478623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.478906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.479021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.479227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.480055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.480194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.480422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.480701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] PATH_INFO: `/v3/projects/325eebbb40ba468fa5588fee7b437bf8/users/1afdfcd13b794a79a96da9f4866c89fc/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.481844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.493088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 803/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.493907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.495763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] RBAC: Authorizing `identity:create_grant(project_id=325eebbb40ba468fa5588fee7b437bf8, user_id=1afdfcd13b794a79a96da9f4866c89fc, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.498621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.503718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3499ad5-cd53-4f49-b8cf-bd715d8a30f8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.509526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.510432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.510775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.511066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.511947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.512441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 799/1602] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/325eebbb40ba468fa5588fee7b437bf8/users/1afdfcd13b794a79a96da9f4866c89fc/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.522137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.522316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.526937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 804/1603] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.531438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.542510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596a3d-8445-43f5-a45a-757514fea157 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.577626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468e2e9-d401-46cc-a048-d0294f76670e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.582414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.583419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.583780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.584133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] PATH_INFO: `/v3/projects/0ab7bf7599ad4630b913b63544929d9c/users/111bb6c0944e4f629f5d7799f4a86be6/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.599075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab7bf7599ad4630b913b63544929d9c, user_id=111bb6c0944e4f629f5d7799f4a86be6, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.599629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f892745-ec99-4419-b9c6-a76b34c04c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.600530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f892745-ec99-4419-b9c6-a76b34c04c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.600806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f892745-ec99-4419-b9c6-a76b34c04c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.601077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f892745-ec99-4419-b9c6-a76b34c04c60 admin admin] PATH_INFO: `/v3/projects/bd0c9fdb2e8e4e72ac2835b0482ae824/users/829c30cd914f48548b987bd6e39ee774/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.601840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.615763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 800/1604] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/0ab7bf7599ad4630b913b63544929d9c/users/111bb6c0944e4f629f5d7799f4a86be6/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.618922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f892745-ec99-4419-b9c6-a76b34c04c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0c9fdb2e8e4e72ac2835b0482ae824, user_id=829c30cd914f48548b987bd6e39ee774, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.619037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.619143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f892745-ec99-4419-b9c6-a76b34c04c60 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.636558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 805/1605] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/bd0c9fdb2e8e4e72ac2835b0482ae824/users/829c30cd914f48548b987bd6e39ee774/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.640516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b99437-a3bf-4cf1-b221-ab1b4ecd257b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.640799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b99437-a3bf-4cf1-b221-ab1b4ecd257b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.641103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b99437-a3bf-4cf1-b221-ab1b4ecd257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.657943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-21b99437-a3bf-4cf1-b221-ab1b4ecd257b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:04.659069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-21b99437-a3bf-4cf1-b221-ab1b4ecd257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:04.680699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e72af-8e8b-4aca-88d1-0dcd69aba13a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.719132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 806/1606] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:04.720664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.720952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.721234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.740154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:04.741376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:04.742666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723de8e5-0604-4d5d-92a1-917dab486cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.743620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de8e5-0604-4d5d-92a1-917dab486cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.743902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de8e5-0604-4d5d-92a1-917dab486cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.744177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723de8e5-0604-4d5d-92a1-917dab486cc1 admin admin] PATH_INFO: `/v3/projects/ec1d676becac4112a7c0c319e54b2cd2/users/a0c9f3f10fd142439521e4b36cf33157/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.749333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 807/1607] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:04.750089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.759754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c34b6-0210-4678-8f3b-e65f304e5d7c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.764336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.765247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.765530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.765806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] PATH_INFO: `/v3/projects/567c0fc3272947a5a55ffce166a5b831/users/be6c213c9951467a9d6af45db2da8c0b/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.766684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723de8e5-0604-4d5d-92a1-917dab486cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1d676becac4112a7c0c319e54b2cd2, user_id=a0c9f3f10fd142439521e4b36cf33157, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.769419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723de8e5-0604-4d5d-92a1-917dab486cc1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.771721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:04.782078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567c0fc3272947a5a55ffce166a5b831, user_id=be6c213c9951467a9d6af45db2da8c0b, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.784651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 801/1608] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/ec1d676becac4112a7c0c319e54b2cd2/users/a0c9f3f10fd142439521e4b36cf33157/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.784794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.786125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.786466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.786802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.801766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 808/1609] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/567c0fc3272947a5a55ffce166a5b831/users/be6c213c9951467a9d6af45db2da8c0b/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.811372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.815280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] MFA Rules not processed for user `1afdfcd13b794a79a96da9f4866c89fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:04.816539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:04.822883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:04.873756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6f579-8643-4c68-a15c-f96574ac6977 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.878856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.879770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.880054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.883629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] PATH_INFO: `/v3/projects/fabcb11a7be746719029396d4abab6cc/users/1cb5512dbadb4b70b030e7e3bb297dad/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.883734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 802/1610] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:04.883734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.892985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7216212-62fd-49f1-9175-3c893a9f7a7d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.896064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fabcb11a7be746719029396d4abab6cc, user_id=1cb5512dbadb4b70b030e7e3bb297dad, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.897887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fddcbf-95c4-45dd-b4d8-a6618d73edf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.898550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddcbf-95c4-45dd-b4d8-a6618d73edf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.898827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.898927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddcbf-95c4-45dd-b4d8-a6618d73edf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.899101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fddcbf-95c4-45dd-b4d8-a6618d73edf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.899863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fddcbf-95c4-45dd-b4d8-a6618d73edf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:04.901616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fddcbf-95c4-45dd-b4d8-a6618d73edf0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:04.912998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 803/1611] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:04.914203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.914706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.914834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 809/1612] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:04 2022] PUT /identity/v3/projects/fabcb11a7be746719029396d4abab6cc/users/1cb5512dbadb4b70b030e7e3bb297dad/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:04.914957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.915632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:04.933324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:04.934674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:04.970560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356377f-e6d3-4c53-b6e1-7eb12e23c3e9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:04.974602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20ec04-c35c-42c8-a399-b8c563c488ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:04.975285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ec04-c35c-42c8-a399-b8c563c488ed service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:04.975565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ec04-c35c-42c8-a399-b8c563c488ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:04.975833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ec04-c35c-42c8-a399-b8c563c488ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:04.994552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 804/1613] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:04.995549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.006717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9218e5-e4ba-4bb4-8283-4b3ba4b96667 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.010443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca8df2-4f57-41b3-bfd5-ceab210c33cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.011088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8df2-4f57-41b3-bfd5-ceab210c33cc service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.011476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8df2-4f57-41b3-bfd5-ceab210c33cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.011751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca8df2-4f57-41b3-bfd5-ceab210c33cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.020893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca8df2-4f57-41b3-bfd5-ceab210c33cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.022326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca8df2-4f57-41b3-bfd5-ceab210c33cc service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.031748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 805/1614] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:05.033173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.033469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.033736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.037787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20ec04-c35c-42c8-a399-b8c563c488ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.039316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b20ec04-c35c-42c8-a399-b8c563c488ed service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.049949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 810/1615] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:05.051032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.051382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.051707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.053679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:05.055209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:05.069807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 806/1616] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:05.070315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.086294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875547e0-6957-48a4-8ceb-643e96073c3b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.092253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456ceb1-8b3d-47a1-975d-cc88cda12880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.092491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] MFA Rules not processed for user `be6c213c9951467a9d6af45db2da8c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:05.092894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ceb1-8b3d-47a1-975d-cc88cda12880 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.093175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ceb1-8b3d-47a1-975d-cc88cda12880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.093446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456ceb1-8b3d-47a1-975d-cc88cda12880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.093704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:05.094141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ceb1-8b3d-47a1-975d-cc88cda12880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.096376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456ceb1-8b3d-47a1-975d-cc88cda12880 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.124976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 807/1617] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:05.126404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.126813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.127019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.134849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:05.146879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:05.148603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:05.174851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 811/1618] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:05.177499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.186988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:05.192902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3b60a-22cb-4b80-934f-121bc59835eb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.236279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 808/1619] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:05.237039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.281840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.282763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.283048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.283356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] PATH_INFO: `/v3/projects/0ab7bf7599ad4630b913b63544929d9c/users/111bb6c0944e4f629f5d7799f4a86be6/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.285539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab7bf7599ad4630b913b63544929d9c, user_id=111bb6c0944e4f629f5d7799f4a86be6, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.288523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.301809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 812/1620] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:05 2022] PUT /identity/v3/projects/0ab7bf7599ad4630b913b63544929d9c/users/111bb6c0944e4f629f5d7799f4a86be6/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:05.302794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.304571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:05.316489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96559e1-7fa4-4a56-a5c1-57bc453841ad None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.377891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3132ec-f6f1-4557-b020-7146798d38f7 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.382744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.383478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.383760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.384372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.388254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.389185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.389716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.390252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.457681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.459773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.472429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 813/1621] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:05.473485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.485444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e8be1-66c0-4833-9c57-bbfe56dbee30 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.491556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.492674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.492974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.493382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.494189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.494549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.496338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.496988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.512539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 809/1622] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:05.513454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.525832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d1f1a-078d-499a-af99-fde6ca5cd2ce service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.527146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 814/1623] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/users => generated 291 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:05.528159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.531291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23bd71-4db3-4ea0-a327-179e3a2fab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.531973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23bd71-4db3-4ea0-a327-179e3a2fab6f admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.532257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23bd71-4db3-4ea0-a327-179e3a2fab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.532532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23bd71-4db3-4ea0-a327-179e3a2fab6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.533328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23bd71-4db3-4ea0-a327-179e3a2fab6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.534650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:05.535196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23bd71-4db3-4ea0-a327-179e3a2fab6f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.543066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06eb48-9b31-4575-98c3-9042603f2fb1 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.549406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.550201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.550728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.551097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.564518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.566307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.572539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 810/1624] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:05.574501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.574795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.575072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.578950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 815/1625] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:05.580174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.591773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a15006-5e2d-4e9b-8c25-9d1b178a78b5 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.614832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] MFA Rules not processed for user `111bb6c0944e4f629f5d7799f4a86be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:05.616907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:05.624481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:05.714140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.714921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.715418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.715798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.717037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.718795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.726667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 811/1626] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:05.728521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.742262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd09d4-c5e6-4e47-b465-419312c3016b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.745719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 816/1627] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:05.750006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.751967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.752978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.753292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.753571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.754399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.757407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.790630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 812/1628] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:05 2022] POST /identity/v3/users => generated 300 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:05.795541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.810802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa1f7a-67cb-4934-9288-94b760d34d73 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.819054 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.821017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.821322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.821609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] PATH_INFO: `/v3/projects/fa3c5d4c92ed4924a0b98e8c89828658/users/250ce01c6e9141278856b4104338f8b2/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.855135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3c5d4c92ed4924a0b98e8c89828658, user_id=250ce01c6e9141278856b4104338f8b2, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.858023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dad765-3da6-4486-b5aa-4743191e588d admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:05.878450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.883044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:05.883874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:05.884435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:05.884815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:05.899526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:05.901369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:05.914968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 813/1629] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:05 2022] PUT /identity/v3/projects/fa3c5d4c92ed4924a0b98e8c89828658/users/250ce01c6e9141278856b4104338f8b2/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:05.916064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.921019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 817/1630] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:05.922397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:05.937240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ad99-28ae-4a92-a618-d96f4aa50f58 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.020837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2067b4-b229-4c2c-a890-d3a6493debef admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.028136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.029853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.030144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.031204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.032934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.035948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.055494 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 814/1631] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:06.060280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:06.115924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.116614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c61da-4e00-49a6-96a3-c5541232f751 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.117515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.117805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.118471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.119117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.121583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.143988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.150563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.150752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.150927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] PATH_INFO: `/v3/projects/56dfef25557e43bb9d143b18e75d92c3/users/cb8be939a8e24d28a54bd820f2b3c4b7/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.162266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 818/1632] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:06.163969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:06.186261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dfef25557e43bb9d143b18e75d92c3, user_id=cb8be939a8e24d28a54bd820f2b3c4b7, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.190325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.220177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 815/1633] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:06 2022] PUT /identity/v3/projects/56dfef25557e43bb9d143b18e75d92c3/users/cb8be939a8e24d28a54bd820f2b3c4b7/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:06.222568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:06.255631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.303412 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f827f-3e2e-47c8-85ea-1bf8d77f8bf3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.368571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.369600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.370032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.370614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.373254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.453042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.454739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.468487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 819/1634] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:06.468487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:06.478991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91157c-97a8-4a5f-be6b-7e7c1cd54da9 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.481212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb972a1-2e79-494a-b535-474f77003e6f service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.487574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690e12-86a5-455d-bf91-c5cabf0a338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.488354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.489103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690e12-86a5-455d-bf91-c5cabf0a338a admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.489394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690e12-86a5-455d-bf91-c5cabf0a338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.489676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690e12-86a5-455d-bf91-c5cabf0a338a admin admin] PATH_INFO: `/v3/projects/fa3c5d4c92ed4924a0b98e8c89828658/users/250ce01c6e9141278856b4104338f8b2/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.489792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.490851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.491138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.493802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67690e12-86a5-455d-bf91-c5cabf0a338a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3c5d4c92ed4924a0b98e8c89828658, user_id=250ce01c6e9141278856b4104338f8b2, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.494593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.497654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67690e12-86a5-455d-bf91-c5cabf0a338a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.498542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.518987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 820/1636] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:06.523698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:06.528116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 816/1636] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:06 2022] PUT /identity/v3/projects/fa3c5d4c92ed4924a0b98e8c89828658/users/250ce01c6e9141278856b4104338f8b2/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:06.531629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.533683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.534107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.545887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233af9aa-3544-456a-84d7-7401d3382772 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.592522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] MFA Rules not processed for user `250ce01c6e9141278856b4104338f8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:06.594897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:06.701934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ea0f2-dbd6-45f4-b323-d2929d866112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.706576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea0f2-dbd6-45f4-b323-d2929d866112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.708398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea0f2-dbd6-45f4-b323-d2929d866112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.708691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ea0f2-dbd6-45f4-b323-d2929d866112 admin admin] PATH_INFO: `/v3/projects/56dfef25557e43bb9d143b18e75d92c3/users/cb8be939a8e24d28a54bd820f2b3c4b7/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.714519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ea0f2-dbd6-45f4-b323-d2929d866112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dfef25557e43bb9d143b18e75d92c3, user_id=cb8be939a8e24d28a54bd820f2b3c4b7, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:06.717882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ea0f2-dbd6-45f4-b323-d2929d866112 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:06.723758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 817/1637] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:06.735875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:06.748513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 821/1638] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:06 2022] PUT /identity/v3/projects/56dfef25557e43bb9d143b18e75d92c3/users/cb8be939a8e24d28a54bd820f2b3c4b7/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:06.765658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.766040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.766388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:06.812164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] MFA Rules not processed for user `cb8be939a8e24d28a54bd820f2b3c4b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:06.816522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:06.829792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:06.833048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba463-7d98-480c-ba99-c4d23e77d007 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:06.962197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 822/1639] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:06.968666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:06.969935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:06.970265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:06.970548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:07.011337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:07.041304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:07.057889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4b467-043f-4fc7-b39b-7eedb29d17ca None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:07.072816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdbdf50-5c87-4e47-8672-f3be358fb3a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:07.073499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbdf50-5c87-4e47-8672-f3be358fb3a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:07.073780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbdf50-5c87-4e47-8672-f3be358fb3a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:07.074163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdbdf50-5c87-4e47-8672-f3be358fb3a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:07.083493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:07.085405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:07.098520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 818/1640] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:07.101786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbdf50-5c87-4e47-8672-f3be358fb3a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:07.103919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdbdf50-5c87-4e47-8672-f3be358fb3a6 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:07.129515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 823/1641] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:07.354112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:07.504516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd723a-7dbb-4045-b0e0-a869987e7400 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:07.522607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:07.523563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:07.523887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:07.524100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] PATH_INFO: `/v3/users/be6c213c9951467a9d6af45db2da8c0b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:07.525404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6c213c9951467a9d6af45db2da8c0b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:07.527443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:07.633646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6c213c9951467a9d6af45db2da8c0b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:07.654315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6c213c9951467a9d6af45db2da8c0b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:07.656345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6c213c9951467a9d6af45db2da8c0b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:07.657271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6c213c9951467a9d6af45db2da8c0b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:07.676615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6c213c9951467a9d6af45db2da8c0b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:07.704052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 819/1642] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:07 2022] DELETE /identity/v3/users/be6c213c9951467a9d6af45db2da8c0b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:07.708984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124469f9-0ef1-4e10-9efa-3a1b427ffe23 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:07.709556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124469f9-0ef1-4e10-9efa-3a1b427ffe23 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:07.709556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124469f9-0ef1-4e10-9efa-3a1b427ffe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:07.732762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-124469f9-0ef1-4e10-9efa-3a1b427ffe23 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:07.734051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-124469f9-0ef1-4e10-9efa-3a1b427ffe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:07.861107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 824/1643] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:07.906631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:07.907370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:07.978485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:08.009800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4aa4e-5830-4abf-ad20-b1514ea52987 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:08.014695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716c56c-fefa-4f39-8f6e-5391e84c523e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:08.016205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c56c-fefa-4f39-8f6e-5391e84c523e service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:08.016724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c56c-fefa-4f39-8f6e-5391e84c523e service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:08.017350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716c56c-fefa-4f39-8f6e-5391e84c523e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:08.040220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716c56c-fefa-4f39-8f6e-5391e84c523e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:08.054168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716c56c-fefa-4f39-8f6e-5391e84c523e service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:08.082694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 820/1644] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:08.276782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8432a-ab09-4f70-b3ce-ab2c10e85dec None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:08.276782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8432a-ab09-4f70-b3ce-ab2c10e85dec None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:08.277073 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8432a-ab09-4f70-b3ce-ab2c10e85dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:08.340145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-99e8432a-ab09-4f70-b3ce-ab2c10e85dec None None] MFA Rules not processed for user `1cb5512dbadb4b70b030e7e3bb297dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:08.341680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-99e8432a-ab09-4f70-b3ce-ab2c10e85dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:08.466696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 825/1645] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:08.486124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a614d02-c125-44ae-95be-b33d23efe39e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:08.486512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a614d02-c125-44ae-95be-b33d23efe39e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:08.486719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a614d02-c125-44ae-95be-b33d23efe39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:08.519853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6a614d02-c125-44ae-95be-b33d23efe39e None None] MFA Rules not processed for user `1cb5512dbadb4b70b030e7e3bb297dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:08.521248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6a614d02-c125-44ae-95be-b33d23efe39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:08.542339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 821/1646] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:08.572176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233f11-67b5-43db-817f-ba2a8b97de3c None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:08.572606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233f11-67b5-43db-817f-ba2a8b97de3c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:08.573018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea233f11-67b5-43db-817f-ba2a8b97de3c None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:08.574676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 826/1647] 10.222.0.45 () {54 vars in 961 bytes} [Wed May 25 16:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:17:08.583705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:08.584008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:08.584294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:08.628049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:08.629304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:08.806885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 822/1648] 10.222.0.45 () {58 vars in 1058 bytes} [Wed May 25 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:08.815198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea233f11-67b5-43db-817f-ba2a8b97de3c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:08.843212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea233f11-67b5-43db-817f-ba2a8b97de3c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:08.858826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaec394-9d74-4405-b483-68984ed61dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:08.859953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec394-9d74-4405-b483-68984ed61dab service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:08.862082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec394-9d74-4405-b483-68984ed61dab service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:08.862593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaec394-9d74-4405-b483-68984ed61dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:08.901559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaec394-9d74-4405-b483-68984ed61dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:08.912792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaec394-9d74-4405-b483-68984ed61dab service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:08.934399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 827/1649] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:09.313644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:09.316612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:09.341862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420ecb-f839-45b4-bc11-4197a04971cd None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:09.342276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420ecb-f839-45b4-bc11-4197a04971cd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:09.342655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69420ecb-f839-45b4-bc11-4197a04971cd None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:09.344845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 828/1650] 10.222.0.45 () {54 vars in 912 bytes} [Wed May 25 16:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:17:09.356329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:09.356824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:09.357201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:09.378319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:09.383043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee122124-1cac-40c2-8aed-78389ce91d53 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:09.395046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:09.395710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:09.396031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:09.396305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] PATH_INFO: `/v3/projects/567c0fc3272947a5a55ffce166a5b831` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:09.398514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:09.399428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567c0fc3272947a5a55ffce166a5b831)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:09.400527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: WARNING py.warnings [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:17:09.400527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: warnings.warn(msg) May 25 16:17:09.400527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: May 25 16:17:09.404989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:09.405990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:09.432523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 829/1651] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:17:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:09.445002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:09.447227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:09.560690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567c0fc3272947a5a55ffce166a5b831', 'request_id': 'req-be374b60-1d15-4693-a84e-2b050d3f6a95'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.581256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567c0fc3272947a5a55ffce166a5b831', 'request_id': 'req-be374b60-1d15-4693-a84e-2b050d3f6a95'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.583618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91df81-5844-4084-839d-5b35b7b122c5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:09.594706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567c0fc3272947a5a55ffce166a5b831', 'request_id': 'req-be374b60-1d15-4693-a84e-2b050d3f6a95'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.639128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] The token cache is being invalidate because project 567c0fc3272947a5a55ffce166a5b831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:09.639448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.644321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.685326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 823/1652] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:09 2022] DELETE /identity/v3/projects/567c0fc3272947a5a55ffce166a5b831 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:09.685326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:09.685326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:09.777774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:09.777938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:09.785445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:09.785801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:09.795426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:09.796002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:09.829498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be374b60-1d15-4693-a84e-2b050d3f6a95 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:09.836518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:09.837609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:09.838219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:09.838917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] PATH_INFO: `/v3/users/cb8be939a8e24d28a54bd820f2b3c4b7` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:09.840098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8be939a8e24d28a54bd820f2b3c4b7)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:09.842732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:09.929768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8be939a8e24d28a54bd820f2b3c4b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.945327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8be939a8e24d28a54bd820f2b3c4b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.946439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8be939a8e24d28a54bd820f2b3c4b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.947996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8be939a8e24d28a54bd820f2b3c4b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.973289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4d55d0b2-a677-4a09-a4f0-ff61218a2f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8be939a8e24d28a54bd820f2b3c4b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:09.977596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:09.979092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:10.005604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 830/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:10.009443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 824/1654] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:09 2022] DELETE /identity/v3/users/cb8be939a8e24d28a54bd820f2b3c4b7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:10.016992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:10.026614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:10.058115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a84849-2f7d-43ca-af43-b218cbcb28da service glance] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:10.156186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:10.168499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:10.169795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:10.170136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:10.170479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] PATH_INFO: `/v3/users/1afdfcd13b794a79a96da9f4866c89fc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:10.176055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afdfcd13b794a79a96da9f4866c89fc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:10.177597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: WARNING py.warnings [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 16:17:10.177597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: warnings.warn(msg) May 25 16:17:10.177597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: May 25 16:17:10.179460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:10.345951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afdfcd13b794a79a96da9f4866c89fc'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:10.348739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afdfcd13b794a79a96da9f4866c89fc'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:10.352124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afdfcd13b794a79a96da9f4866c89fc'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:10.367667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afdfcd13b794a79a96da9f4866c89fc'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:10.420553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-428b7421-f4c1-4337-8431-fdb80f69ddf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afdfcd13b794a79a96da9f4866c89fc'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:10.469518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 831/1655] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:10 2022] DELETE /identity/v3/users/1afdfcd13b794a79a96da9f4866c89fc => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:10.473185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:10.474663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:10.475243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:10.518652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:10.520132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b933-d9e5-487b-83a8-48f60f7c1fe6 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:10.520697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b933-d9e5-487b-83a8-48f60f7c1fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:10.521163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272b933-d9e5-487b-83a8-48f60f7c1fe6 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:10.522529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 832/1656] 10.222.0.45 () {54 vars in 912 bytes} [Wed May 25 16:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:17:10.523003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:10.529928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:10.530521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:10.531048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:10.643583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 825/1657] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:10.690572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:10.692933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:10.825543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ea221-a9a5-45bf-92d4-21965f4fa9a4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:10.836804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:10.837747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:10.838124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:10.838504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:10.849760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] MFA Rules not processed for user `99e8bd308e5549618c66d6edaf02523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:10.853306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:10.859993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:10.862106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:10.872981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 833/1658] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:17:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:10.900680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 826/1659] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:10.938245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:10.948826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022cdfc-02ef-46c3-8fb5-636250a8de14 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:10.962719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bdeeb-3284-49c7-93fb-005e6bd2dfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:10.963822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdeeb-3284-49c7-93fb-005e6bd2dfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:10.964112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdeeb-3284-49c7-93fb-005e6bd2dfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:10.964568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdeeb-3284-49c7-93fb-005e6bd2dfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:10.981495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bdeeb-3284-49c7-93fb-005e6bd2dfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:10.984305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bdeeb-3284-49c7-93fb-005e6bd2dfa3 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:10.997370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 834/1660] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:11.924411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:11.926442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:11.950975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30fa1-f55b-4b04-8956-8f29a02d3981 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:11.968046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:11.969146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:11.969425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:11.970176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] PATH_INFO: `/v3/projects/56dfef25557e43bb9d143b18e75d92c3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:11.971882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dfef25557e43bb9d143b18e75d92c3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:11.974559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:11.979431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:12.096910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dfef25557e43bb9d143b18e75d92c3', 'request_id': 'req-4edf046f-a89b-4f73-b4b9-b05067717981'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:12.110647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dfef25557e43bb9d143b18e75d92c3', 'request_id': 'req-4edf046f-a89b-4f73-b4b9-b05067717981'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:12.129073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dfef25557e43bb9d143b18e75d92c3', 'request_id': 'req-4edf046f-a89b-4f73-b4b9-b05067717981'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:12.168399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] The token cache is being invalidate because project 56dfef25557e43bb9d143b18e75d92c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:12.168684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:12.169437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4edf046f-a89b-4f73-b4b9-b05067717981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:12.175486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 827/1661] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:11 2022] DELETE /identity/v3/projects/56dfef25557e43bb9d143b18e75d92c3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:12.178898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:12.179486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:12.180053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:12.215995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:12.217434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:12.356935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 835/1662] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:12.364605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:12.364892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:12.365175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:12.402466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:12.403739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:12.447451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 828/1663] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:12.447711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:12.466675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e7da5-4327-4d09-b040-0ef2fc0b5337 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:12.489940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:12.493901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:12.494436 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:12.495491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:12.496448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:12.496924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:12.500672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:12.548335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 836/1664] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:12.549877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:12.570658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8e6cf-104f-4046-aca3-c9ce662fa388 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:12.585614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:12.586396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:12.586681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:12.586957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:12.587727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:12.589689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:12.657052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 829/1665] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:12 2022] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:12.658366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:12.671858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528355aa-8854-4ef0-8b6b-67a6e1304214 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:12.738601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:12.863130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:12.864313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:12.864493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:12.864843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:12.865764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:12.874148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:12.978077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 837/1666] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:12 2022] POST /identity/v3/users => generated 304 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:12.984313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.008888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b3f74-157d-41ab-a28f-f1f748ccee6d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:13.031135 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:13.032230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.033409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.035379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.042583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:13.044838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:13.103577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.116731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 830/1667] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:13.119200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2502ab-8327-461b-bee8-0aa0d8e6efaa admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:13.126206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:13.127826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.128335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.129524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.132045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:13.135538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.138176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:13.158568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:13.194396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d9f6-f168-4a71-825b-45be8cd49f6d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:13.226212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 838/1668] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:13.229738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.240775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:13.244586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.251249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.251706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] PATH_INFO: `/v3/projects/325eebbb40ba468fa5588fee7b437bf8` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.255499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325eebbb40ba468fa5588fee7b437bf8)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:13.260384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:13.263218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844b1bd-7eef-4694-95c3-810da94166b8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:13.280459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716ecc0-8b43-4b81-a239-a2c0480aa0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:13.281530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716ecc0-8b43-4b81-a239-a2c0480aa0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.283145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716ecc0-8b43-4b81-a239-a2c0480aa0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.286174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716ecc0-8b43-4b81-a239-a2c0480aa0fe admin admin] PATH_INFO: `/v3/projects/4f9e3633a8ee4d289106d60867d84cc9/users/e0099bd408f0414f80f4095928685c4e/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.355480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716ecc0-8b43-4b81-a239-a2c0480aa0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9e3633a8ee4d289106d60867d84cc9, user_id=e0099bd408f0414f80f4095928685c4e, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:13.360194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716ecc0-8b43-4b81-a239-a2c0480aa0fe admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:13.415421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 839/1669] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:13 2022] PUT /identity/v3/projects/4f9e3633a8ee4d289106d60867d84cc9/users/e0099bd408f0414f80f4095928685c4e/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:13.417471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.417790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.418131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.452264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325eebbb40ba468fa5588fee7b437bf8', 'request_id': 'req-1156b756-2887-46c0-99e5-62a48befa3a3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.470191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325eebbb40ba468fa5588fee7b437bf8', 'request_id': 'req-1156b756-2887-46c0-99e5-62a48befa3a3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.495205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325eebbb40ba468fa5588fee7b437bf8', 'request_id': 'req-1156b756-2887-46c0-99e5-62a48befa3a3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.498489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] MFA Rules not processed for user `e0099bd408f0414f80f4095928685c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:13.500056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:13.533263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] The token cache is being invalidate because project 325eebbb40ba468fa5588fee7b437bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:13.533613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.534759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.540877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 831/1670] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:13 2022] DELETE /identity/v3/projects/325eebbb40ba468fa5588fee7b437bf8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:13.542665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.545095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:13.617766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 840/1671] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:13.618815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.620277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:13.729198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:13.796569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a35cd-5639-4091-b2e8-cecd0df8b5e1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:13.799846 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156b756-2887-46c0-99e5-62a48befa3a3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:13.815917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6c085-eb54-47ba-8fcc-e214e9d6a80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:13.818416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c085-eb54-47ba-8fcc-e214e9d6a80a admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.818733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c085-eb54-47ba-8fcc-e214e9d6a80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.819143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6c085-eb54-47ba-8fcc-e214e9d6a80a admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.821064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c085-eb54-47ba-8fcc-e214e9d6a80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:13.827641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6c085-eb54-47ba-8fcc-e214e9d6a80a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:13.828223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:13.829345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.831276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.831747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] PATH_INFO: `/v3/users/250ce01c6e9141278856b4104338f8b2` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.841689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=250ce01c6e9141278856b4104338f8b2)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:13.844312 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:13.878660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:13.894274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 841/1672] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:13 2022] POST /identity/v3/projects => generated 409 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:13.900783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01946a3-7012-432c-88b5-3cf4d511e92a None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:13.901952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01946a3-7012-432c-88b5-3cf4d511e92a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:13.902282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01946a3-7012-432c-88b5-3cf4d511e92a None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:13.907522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 842/1673] 10.222.0.45 () {54 vars in 960 bytes} [Wed May 25 16:17:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:17:13.910792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01946a3-7012-432c-88b5-3cf4d511e92a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:13.975557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250ce01c6e9141278856b4104338f8b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.992648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250ce01c6e9141278856b4104338f8b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.994068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250ce01c6e9141278856b4104338f8b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:13.995363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250ce01c6e9141278856b4104338f8b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:14.027058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-468d287c-a483-4c2d-a9d5-7f243e827727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250ce01c6e9141278856b4104338f8b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:14.058053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 832/1674] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:13 2022] DELETE /identity/v3/users/250ce01c6e9141278856b4104338f8b2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:14.068111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24636-ddc5-4105-a448-35c171743d3b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.068400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24636-ddc5-4105-a448-35c171743d3b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.068683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa24636-ddc5-4105-a448-35c171743d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.108945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-faa24636-ddc5-4105-a448-35c171743d3b None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:14.113603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-faa24636-ddc5-4105-a448-35c171743d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:14.148032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01946a3-7012-432c-88b5-3cf4d511e92a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.249496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 833/1675] 10.222.0.45 () {58 vars in 1057 bytes} [Wed May 25 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:14.256115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a6788-af17-4009-8596-1ee177c136dc None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.256115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a6788-af17-4009-8596-1ee177c136dc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.258660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a6788-af17-4009-8596-1ee177c136dc None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.266684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 834/1676] 10.222.0.45 () {54 vars in 961 bytes} [Wed May 25 16:17:14 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:17:14.270734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a6788-af17-4009-8596-1ee177c136dc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:14.290413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a6788-af17-4009-8596-1ee177c136dc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.299422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.300986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.301597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.302196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.304840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:14.322536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:14.325442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e225ede-4306-4382-bc33-7fb797d2f81c service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:14.336066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.336927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.337355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.337555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.338272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:14.340805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:14.342368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 835/1677] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:14.344469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05573b5-60cd-4ffa-b790-961d03a18e4a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.345541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05573b5-60cd-4ffa-b790-961d03a18e4a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.346017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05573b5-60cd-4ffa-b790-961d03a18e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.378281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e05573b5-60cd-4ffa-b790-961d03a18e4a None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:14.380655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e05573b5-60cd-4ffa-b790-961d03a18e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:14.404630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 843/1678] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:13 2022] POST /identity/v3/users => generated 311 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:14.405550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:14.414902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:14.444391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:14.459084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4ffb1-6fef-4c5e-a2a7-6ba7ef8134e6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.483677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.484483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.484666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.484943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.485690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:14.496053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 836/1679] 10.222.0.45 () {58 vars in 1058 bytes} [Wed May 25 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:14.498659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:14.501965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d61d1-541e-4c8a-8f6b-5cb8e136efd7 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.502485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d61d1-541e-4c8a-8f6b-5cb8e136efd7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.503538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d61d1-541e-4c8a-8f6b-5cb8e136efd7 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.507309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 837/1680] 10.222.0.45 () {54 vars in 912 bytes} [Wed May 25 16:17:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:17:14.514707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.516253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.518000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.532087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 844/1681] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:14.542531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:14.579794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5350cd7-5eec-47ec-92f9-395ca0112463 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.583772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:14.586687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:14.594140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.595068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.595375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.595649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] PATH_INFO: `/v3/projects/544ef00bd2034b568b5408757038e9fc/users/487fe1284211447baf4f96a91afd43bc/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.602703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 838/1682] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:17:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:14.653147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=544ef00bd2034b568b5408757038e9fc, user_id=487fe1284211447baf4f96a91afd43bc, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:14.657430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:14.701096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 845/1683] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:14 2022] PUT /identity/v3/projects/544ef00bd2034b568b5408757038e9fc/users/487fe1284211447baf4f96a91afd43bc/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:14.702704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:14.730377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52744380-3f4e-41ff-aca0-2c3244033171 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.753787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:14.755629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:14.924116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.927340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.927787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.928329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.929419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:14.932447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:14.947315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 839/1684] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:14.951549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:14.970018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d6718-dfa3-4605-a075-e761aa3ea7e7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.970334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48922c8-0c7e-421e-95a0-c64a89e53677 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:14.980217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d92b64-609f-4051-a074-fa38b07c262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.981433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92b64-609f-4051-a074-fa38b07c262b admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.981848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92b64-609f-4051-a074-fa38b07c262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.982285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d92b64-609f-4051-a074-fa38b07c262b admin admin] PATH_INFO: `/v3/projects/544ef00bd2034b568b5408757038e9fc/users/487fe1284211447baf4f96a91afd43bc/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.986926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d92b64-609f-4051-a074-fa38b07c262b admin admin] RBAC: Authorizing `identity:create_grant(project_id=544ef00bd2034b568b5408757038e9fc, user_id=487fe1284211447baf4f96a91afd43bc, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:14.990430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:14.991615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:14.991898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:14.992172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:14.992872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d92b64-609f-4051-a074-fa38b07c262b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:15.027388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:15.058814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 840/1685] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:14 2022] PUT /identity/v3/projects/544ef00bd2034b568b5408757038e9fc/users/487fe1284211447baf4f96a91afd43bc/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:15.078892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:15.079353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:15.079790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:15.126741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] MFA Rules not processed for user `487fe1284211447baf4f96a91afd43bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:15.128024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:15.188202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:15.189698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:15.234577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 846/1686] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:15.340857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 841/1687] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:15.354156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:15.355832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:15.531186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a01f31-20f6-40e2-bc40-d2de593a9abe service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:15.668968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:15.669665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:15.669946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:15.670219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:15.712605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:15.714100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:15.734811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 847/1688] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:15 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:16.129289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:16.164211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8003d-623d-48ed-a670-76fae6ae33f9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:16.175541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:16.176355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:16.176653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:16.177385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:16.183781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:16.240086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:16.242513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:16.312405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:16.435183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d200f9-9aa4-4f93-a57d-6f5261b61597 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:16.447563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:16.448639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:16.449243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:16.449616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] PATH_INFO: `/v3/projects/fa3c5d4c92ed4924a0b98e8c89828658` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:16.451351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3c5d4c92ed4924a0b98e8c89828658)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:16.453396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:16.459519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:16.504019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:16.518284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe26e46-f58d-43bc-bf47-ccde084774fb service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:16.575978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 842/1689] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:16.671849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3c5d4c92ed4924a0b98e8c89828658', 'request_id': 'req-4b7c6093-01d0-47c6-9b19-344df553a9bf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:16.690544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3c5d4c92ed4924a0b98e8c89828658', 'request_id': 'req-4b7c6093-01d0-47c6-9b19-344df553a9bf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:16.705357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3c5d4c92ed4924a0b98e8c89828658', 'request_id': 'req-4b7c6093-01d0-47c6-9b19-344df553a9bf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:16.750060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] The token cache is being invalidate because project fa3c5d4c92ed4924a0b98e8c89828658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:16.750060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:16.751598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b7c6093-01d0-47c6-9b19-344df553a9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:16.761598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 848/1690] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:16 2022] DELETE /identity/v3/projects/fa3c5d4c92ed4924a0b98e8c89828658 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:16.763651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:16.764370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:16.765156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:16.821711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:16.827417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:17.087701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 843/1691] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:17.095096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.095703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.096192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.137622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:17.139089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:17.170375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 849/1692] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:17.174359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:17.190406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d077-5dc8-4459-a700-b2074c22ac75 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:17.210265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:17.210956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.211267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.211689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.213646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:17.213646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:17.214354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:17.263041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:17.273864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 844/1693] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:17.277077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e9cc-6f9b-4e28-be1f-ee08f3b2ae9d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:17.311912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:17.312608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.312889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.313158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.313862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:17.315840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:17.397901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 850/1694] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:17 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:17.398318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:17.409072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056da7ed-f187-485e-9504-6890ca9fffbe admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:17.575786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:17.576024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.576310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.576586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.577289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:17.579278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:17.629856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 845/1695] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:17 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:17.632887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:17.670333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383cd4f-f192-4f1f-a8b7-142b88585eab admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:17.680302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:17.681277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.681702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.682137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.683042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:17.684876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:17.705770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 851/1696] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:17.708412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:17.725027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d28fae-736a-483f-af34-9850fe2a3f67 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:17.732637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a982e-8b1d-4bc6-a309-c937a64340c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:17.733382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a982e-8b1d-4bc6-a309-c937a64340c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.733931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a982e-8b1d-4bc6-a309-c937a64340c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.734212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a982e-8b1d-4bc6-a309-c937a64340c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.734996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a982e-8b1d-4bc6-a309-c937a64340c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:17.736952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a982e-8b1d-4bc6-a309-c937a64340c9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:17.760097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:17.768503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 846/1697] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:17.799991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc02c37-7a16-4f3b-aad9-b117848bf052 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:17.810091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:17.811083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.811404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.811684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] PATH_INFO: `/v3/projects/bf76060ce2d74a7cb2fe409cc756b5bb/users/39adc619f40749d3b7d880515373a602/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.841487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf76060ce2d74a7cb2fe409cc756b5bb, user_id=39adc619f40749d3b7d880515373a602, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:17.844654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:17.896738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:17.897158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 852/1698] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:17 2022] PUT /identity/v3/projects/bf76060ce2d74a7cb2fe409cc756b5bb/users/39adc619f40749d3b7d880515373a602/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:17.897513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:17.897929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:17.976436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] MFA Rules not processed for user `39adc619f40749d3b7d880515373a602`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:17.977679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:18.030696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:18.147393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 847/1699] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:18.153166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:18.290579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b22351-1f9a-41ca-b984-79d23bd0ec5c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:18.316458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed259d-cde0-4793-a92d-cf91242e6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:18.317684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed259d-cde0-4793-a92d-cf91242e6d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:18.318033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed259d-cde0-4793-a92d-cf91242e6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:18.319061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed259d-cde0-4793-a92d-cf91242e6d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:18.319850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed259d-cde0-4793-a92d-cf91242e6d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:18.324154 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed259d-cde0-4793-a92d-cf91242e6d5e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:18.406697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:18.409069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 853/1700] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:18 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:18.424279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:18.424693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:18.424978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:18.430866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b658466-763f-41c1-b7a6-d93294bd6e40 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:18.493709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:18.494429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:18.531036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:18.622776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:18.623502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:18.623791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:18.624073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:18.624778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:18.626861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:18.684744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 854/1701] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:18.688612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 848/1702] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:18 2022] POST /identity/v3/users => generated 296 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:18.692907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:18.718235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eba2c-b712-4333-86b6-b48dfdcc2fe1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:18.727997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:18.728882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:18.729244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:18.729554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:18.739683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:18.741418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:18.770391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 855/1703] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:18.771612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:18.792397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0618d-516b-41f0-bd7b-23738ada9ab6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:18.806498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:18.807967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:18.808258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:18.808547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] PATH_INFO: `/v3/projects/f93a45af7c474136925d27a6a6378a0d/users/d3e904b5c86b4c98a713b8ac85f51a91/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:18.867603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93a45af7c474136925d27a6a6378a0d, user_id=d3e904b5c86b4c98a713b8ac85f51a91, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:18.869900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:18.917452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 849/1704] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:18 2022] PUT /identity/v3/projects/f93a45af7c474136925d27a6a6378a0d/users/d3e904b5c86b4c98a713b8ac85f51a91/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:18.921690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:18.953809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaa9e4-c26f-49b3-985e-f4cddb8917d7 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:19.031768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:19.034147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:19.128849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:19.129550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:19.129799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:19.130065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:19.131353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:19.132688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:19.170495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 856/1705] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:19.171589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:19.197824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268079c-19dd-474c-8666-ecb4f8f2cd1a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:19.221189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c5c9f-4603-4f30-970a-5cd95861dd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:19.222105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c5c9f-4603-4f30-970a-5cd95861dd70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:19.222386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c5c9f-4603-4f30-970a-5cd95861dd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:19.222661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c5c9f-4603-4f30-970a-5cd95861dd70 admin admin] PATH_INFO: `/v3/projects/f93a45af7c474136925d27a6a6378a0d/users/d3e904b5c86b4c98a713b8ac85f51a91/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:19.238389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c5c9f-4603-4f30-970a-5cd95861dd70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93a45af7c474136925d27a6a6378a0d, user_id=d3e904b5c86b4c98a713b8ac85f51a91, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:19.241195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c5c9f-4603-4f30-970a-5cd95861dd70 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:19.260520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d448b45-e9ed-4394-908e-6d3ae6f09e6f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:19.282588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 857/1706] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:19 2022] PUT /identity/v3/projects/f93a45af7c474136925d27a6a6378a0d/users/d3e904b5c86b4c98a713b8ac85f51a91/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:19.284737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:19.285442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:19.285728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:19.286004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:19.295135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:19.295450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:19.295729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:19.361581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] MFA Rules not processed for user `d3e904b5c86b4c98a713b8ac85f51a91`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:19.362842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:19.379410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:19.444216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:19.446262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:19.482019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 850/1707] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:17:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 16:17:19.514174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 858/1708] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:19.522801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:19.524287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:19.673500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e64fe-696b-42d6-a23c-696645679d91 service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:20.133310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:20.135981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:20.136489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:20.136975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:20.160393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:20.162313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:20.216472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 851/1709] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:20.890433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:20.902897 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386ce7c-c946-444f-9b65-5c18cffcd748 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:20.913850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e904b5c86b4c98a713b8ac85f51a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93a45af7c474136925d27a6a6378a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:20.914812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:20.915256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:20.915763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:20.917012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:20.917424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:20.919212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:20.945320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 859/1710] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:20.947709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:20.961546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edb38d-7fd0-49e6-bde2-fa5527bdc3b2 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:20.987948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e904b5c86b4c98a713b8ac85f51a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93a45af7c474136925d27a6a6378a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:20.988675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:20.992180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:20.992687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:20.994263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:21.000355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:21.120961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 852/1711] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:20 2022] POST /identity/v3/projects => generated 352 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:21.123090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:21.130657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:21.141332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f71877-fec8-4147-865b-361a8f1ba6ae tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:21.284826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e904b5c86b4c98a713b8ac85f51a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93a45af7c474136925d27a6a6378a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:21.286354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:21.286979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:21.287509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:21.288604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:21.289109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:21.292249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dd560-f6d3-40eb-b107-c3a4da26b403 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:21.309211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 860/1712] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:17:21.386575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:21.412107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fac9-39fb-43c2-8253-91b44d2ae491 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:21.428944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e904b5c86b4c98a713b8ac85f51a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93a45af7c474136925d27a6a6378a0d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:21.433865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:21.434351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:21.435627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] PATH_INFO: `/v3/projects/81fd9a7acd754960bab0ab4ee9a61781` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:21.438473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorizing `identity:delete_project(project_id=81fd9a7acd754960bab0ab4ee9a61781)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:21.444813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:21.562203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fd9a7acd754960bab0ab4ee9a61781', 'request_id': 'req-5387c1d1-2342-4861-9571-886d73856f70'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:21.570906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fd9a7acd754960bab0ab4ee9a61781', 'request_id': 'req-5387c1d1-2342-4861-9571-886d73856f70'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:21.580674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fd9a7acd754960bab0ab4ee9a61781', 'request_id': 'req-5387c1d1-2342-4861-9571-886d73856f70'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:21.582256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:21.616720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] The token cache is being invalidate because project 81fd9a7acd754960bab0ab4ee9a61781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:21.617012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:21.619912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5387c1d1-2342-4861-9571-886d73856f70 tempest-VolumeQuotaClassesTest-321583736 tempest-VolumeQuotaClassesTest-321583736-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:21.621788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 853/1713] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:21 2022] DELETE /identity/v3/projects/81fd9a7acd754960bab0ab4ee9a61781 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:21.866648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3498-bdb7-4030-a682-5d4a3db6df40 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:21.867016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3498-bdb7-4030-a682-5d4a3db6df40 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:21.867538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3498-bdb7-4030-a682-5d4a3db6df40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:21.992127 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-99be3498-bdb7-4030-a682-5d4a3db6df40 None None] MFA Rules not processed for user `e4e4d39c5ed249bc9dc097ba4c24b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:21.997401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-99be3498-bdb7-4030-a682-5d4a3db6df40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:22.147757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:22.148703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:22.149105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:22.226564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 861/1714] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:22.228362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:22.228793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:22.229205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:22.252290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] MFA Rules not processed for user `06ba885a0b164134898c42a332feba76`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:22.256710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:22.276518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] MFA Rules not processed for user `99e8bd308e5549618c66d6edaf02523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:22.278018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:22.480690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 854/1715] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:22.480690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:22.486072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 862/1716] 10.222.0.78 () {58 vars in 1015 bytes} [Wed May 25 16:17:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:22.487511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:22.488123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:22.494871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:22.644157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:22.730050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb829-e824-4eb8-8745-c9cff5cf6f9a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:22.737750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:22.738933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:22.739500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:22.739933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] PATH_INFO: `/v3/users/39adc619f40749d3b7d880515373a602` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:22.741736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39adc619f40749d3b7d880515373a602)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:22.747447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:22.837488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b3d37-4728-463b-a428-110a6860b762 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:22.864565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:22.868173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:22.868440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:22.868732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:22.871705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39adc619f40749d3b7d880515373a602'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:22.873600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39adc619f40749d3b7d880515373a602'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:22.874659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39adc619f40749d3b7d880515373a602'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:22.890815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:22.899280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39adc619f40749d3b7d880515373a602'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:22.924365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:22.993533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 855/1717] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:23.004222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39adc619f40749d3b7d880515373a602'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:23.005142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:23.016343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:23.074754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 863/1718] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:22 2022] DELETE /identity/v3/users/39adc619f40749d3b7d880515373a602 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:23.077037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:23.082864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:23.086527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95830862-3939-4e85-ad67-4dc9825f855c service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:23.278134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008aec4-eb73-4a66-814c-7062f17eaf26 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:23.299680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:23.305215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:23.306368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:23.308273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:23.337563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:23.342673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:23.361042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:23.363657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:23.365453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:23.365867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:23.369183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:23.400028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:23.407354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f98caa-decb-4041-990b-1ab5c4d4b522 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:23.456573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 864/1719] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:23.457215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:23.457789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:23.458146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:23.535399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:23.542314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:23.547021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:23.549018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:23.580769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 856/1720] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:23.676392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:23.722532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 865/1721] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:23.772431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:23.776087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:23.811678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9134c-3c38-4ea5-90cc-cbb7a8e72d55 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:23.835749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:23.836530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:23.836878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:23.837240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:23.865609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:23.868121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:23.905127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 857/1722] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:25.387780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:25.389476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:25.437666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8cf5f-0a53-4522-9f93-74ea9e73b171 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:25.476979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:25.477895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:25.478174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:25.482987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] PATH_INFO: `/v3/projects/bf76060ce2d74a7cb2fe409cc756b5bb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:25.487486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf76060ce2d74a7cb2fe409cc756b5bb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:25.499933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:25.751378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf76060ce2d74a7cb2fe409cc756b5bb', 'request_id': 'req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:25.782627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf76060ce2d74a7cb2fe409cc756b5bb', 'request_id': 'req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:25.820722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf76060ce2d74a7cb2fe409cc756b5bb', 'request_id': 'req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:25.874789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] The token cache is being invalidate because project bf76060ce2d74a7cb2fe409cc756b5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:25.875127 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:25.877246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:25.879527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 866/1723] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:25 2022] DELETE /identity/v3/projects/bf76060ce2d74a7cb2fe409cc756b5bb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:25.884194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:25.923252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b605f0-01ad-4493-a0e6-cf5e44952974 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:26.102267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:26.103635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:26.103775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:26.104020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] PATH_INFO: `/v3/users/d3e904b5c86b4c98a713b8ac85f51a91` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:26.109140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e904b5c86b4c98a713b8ac85f51a91)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:26.111456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:26.274196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e904b5c86b4c98a713b8ac85f51a91'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:26.293099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e904b5c86b4c98a713b8ac85f51a91'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:26.294226 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e904b5c86b4c98a713b8ac85f51a91'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:26.296018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e904b5c86b4c98a713b8ac85f51a91'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:26.365801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-70a91c61-7917-4f42-bb7b-c32e3b22e419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e904b5c86b4c98a713b8ac85f51a91'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:26.402231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 858/1724] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:25 2022] DELETE /identity/v3/users/d3e904b5c86b4c98a713b8ac85f51a91 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:26.663889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:26.666160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:26.695823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4ea49-0b73-4bc2-a2da-d85b1072711f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:26.952835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:26.954524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:26.957669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:26.958925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] PATH_INFO: `/v3/users/e0099bd408f0414f80f4095928685c4e` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:26.966474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0099bd408f0414f80f4095928685c4e)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:26.981453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:27.104368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0099bd408f0414f80f4095928685c4e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:27.105553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0099bd408f0414f80f4095928685c4e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:27.109479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0099bd408f0414f80f4095928685c4e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:27.143678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0099bd408f0414f80f4095928685c4e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:27.181360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0099bd408f0414f80f4095928685c4e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:27.211507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:27.231431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 867/1725] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:26 2022] DELETE /identity/v3/users/e0099bd408f0414f80f4095928685c4e => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:27.237998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f531-15e4-45ed-9566-e9a563e3881c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:27.241579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f531-15e4-45ed-9566-e9a563e3881c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:27.241579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516f531-15e4-45ed-9566-e9a563e3881c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:27.285138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3516f531-15e4-45ed-9566-e9a563e3881c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:27.286862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3516f531-15e4-45ed-9566-e9a563e3881c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:27.292590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:27.449138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 859/1726] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:27.578333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:27.580499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:27.770484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b2232-726e-445b-86f4-ea6b33997198 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:27.788025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ae88-708b-4ed6-9b53-e8c07191ab06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:27.792659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ae88-708b-4ed6-9b53-e8c07191ab06 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:27.799541 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ae88-708b-4ed6-9b53-e8c07191ab06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:27.801634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ae88-708b-4ed6-9b53-e8c07191ab06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:27.830105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ae88-708b-4ed6-9b53-e8c07191ab06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:27.833200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ae88-708b-4ed6-9b53-e8c07191ab06 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:27.889501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 868/1727] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:29.102079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e55b4-3105-4365-a298-282774f99a8a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:29.108388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e55b4-3105-4365-a298-282774f99a8a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:29.109041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e55b4-3105-4365-a298-282774f99a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:29.153752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-668e55b4-3105-4365-a298-282774f99a8a None None] MFA Rules not processed for user `a0c9f3f10fd142439521e4b36cf33157`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:29.155239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-668e55b4-3105-4365-a298-282774f99a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:29.211145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b261b-7b48-4cfa-bd4a-239866fe2f4c None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:29.212506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b261b-7b48-4cfa-bd4a-239866fe2f4c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:29.213075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b261b-7b48-4cfa-bd4a-239866fe2f4c None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:29.217453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 869/1728] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:17:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:17:29.307571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 860/1729] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:29.315245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b261b-7b48-4cfa-bd4a-239866fe2f4c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:29.320714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-287b261b-7b48-4cfa-bd4a-239866fe2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:29.346322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:29.347190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:29.347579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:29.434282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:29.435989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:29.683794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b261b-7b48-4cfa-bd4a-239866fe2f4c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:29.708552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed86287-1562-4c3c-8f18-ea7923097f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:29.714991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed86287-1562-4c3c-8f18-ea7923097f24 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:29.716649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed86287-1562-4c3c-8f18-ea7923097f24 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:29.718810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed86287-1562-4c3c-8f18-ea7923097f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:29.723335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 861/1730] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:17:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:29.753747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed86287-1562-4c3c-8f18-ea7923097f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:29.761354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed86287-1562-4c3c-8f18-ea7923097f24 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:29.767905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:29.770014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:29.800385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 870/1731] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:29.809719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336fce9-538e-4018-8148-e9cfaa7a822c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:29.816948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:29.818278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:29.818940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:29.819535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] PATH_INFO: `/v3/users/bd038a81f4ec4e4899edc24676e110a6` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:29.830057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd038a81f4ec4e4899edc24676e110a6)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:29.832934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:29.956975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:30.010651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd038a81f4ec4e4899edc24676e110a6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:30.030903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd038a81f4ec4e4899edc24676e110a6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:30.033761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd038a81f4ec4e4899edc24676e110a6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:30.034539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd038a81f4ec4e4899edc24676e110a6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:30.086121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd038a81f4ec4e4899edc24676e110a6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:30.130064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 862/1732] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:29 2022] DELETE /identity/v3/users/bd038a81f4ec4e4899edc24676e110a6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:30.134465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4a12-9bcd-4c6e-8036-733774b9d1d5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:30.134757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4a12-9bcd-4c6e-8036-733774b9d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:30.135037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4a12-9bcd-4c6e-8036-733774b9d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:30.171664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c45a4a12-9bcd-4c6e-8036-733774b9d1d5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:30.172915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c45a4a12-9bcd-4c6e-8036-733774b9d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.241968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:30.243788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.365702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 871/1733] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:30.369096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:30.369465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:30.369884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:30.416307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] MFA Rules not processed for user `829c30cd914f48548b987bd6e39ee774`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:30.422144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.479526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:30.606380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004baad-bb9c-4bd7-b79f-ebbdef704169 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:30.628483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:30.629361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 872/1734] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:30.630816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:30.632198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:30.632783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:30.635115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:30.636077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.640585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.691902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:30.700623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167c399-e88b-4b81-b4d0-40e831470679 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:30.769152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 863/1735] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:30.774881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:30.779084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:30.783867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:30.788766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065b68a-5737-4a9b-ad3a-3d959ae0fc7f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:30.799634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:30.800319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:30.800603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:30.800959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:30.843693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:30.851931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:30.853369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] MFA Rules not processed for user `829c30cd914f48548b987bd6e39ee774`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:30.859349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.898208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 864/1736] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:30.900572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:30.906097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.910384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 873/1737] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:30.918629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:30.921830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:30.961882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a6637-b7af-46f7-993e-c1b7098d4c56 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:30.968844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ec09f-6dbe-404f-a952-16ee1721a828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:30.969520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec09f-6dbe-404f-a952-16ee1721a828 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:30.969799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec09f-6dbe-404f-a952-16ee1721a828 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:30.970087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec09f-6dbe-404f-a952-16ee1721a828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:30.974487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212309d2-115e-48b0-b2e0-a72e37c68e3e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:30.991823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ec09f-6dbe-404f-a952-16ee1721a828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:30.994352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ec09f-6dbe-404f-a952-16ee1721a828 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:31.023436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:31.024317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.024601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.024880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] PATH_INFO: `/v3/projects/f93a45af7c474136925d27a6a6378a0d` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.029064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93a45af7c474136925d27a6a6378a0d)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:31.039911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:31.067706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 874/1738] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:31.199764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93a45af7c474136925d27a6a6378a0d', 'request_id': 'req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.215276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93a45af7c474136925d27a6a6378a0d', 'request_id': 'req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.229988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93a45af7c474136925d27a6a6378a0d', 'request_id': 'req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.255917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] The token cache is being invalidate because project f93a45af7c474136925d27a6a6378a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:31.256316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.258695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.259989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 865/1739] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:30 2022] DELETE /identity/v3/projects/f93a45af7c474136925d27a6a6378a0d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:31.265540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0da3-e72a-47ac-a67b-89205dd1e016 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.266198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0da3-e72a-47ac-a67b-89205dd1e016 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.266606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d0da3-e72a-47ac-a67b-89205dd1e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.305898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:31.307592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:31.313649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-790d0da3-e72a-47ac-a67b-89205dd1e016 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:31.315667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:31.316827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-790d0da3-e72a-47ac-a67b-89205dd1e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:31.527947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3044b-87a7-4f78-ac5f-8ab0d236eda6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:31.546063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:31.547114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.547554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.547836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] PATH_INFO: `/v3/projects/4f9e3633a8ee4d289106d60867d84cc9` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.550882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9e3633a8ee4d289106d60867d84cc9)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:31.557329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:31.560767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 875/1740] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:31.577127 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.584230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.585644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.645537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:31.649698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:31.684760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9e3633a8ee4d289106d60867d84cc9', 'request_id': 'req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.700544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9e3633a8ee4d289106d60867d84cc9', 'request_id': 'req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.728631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9e3633a8ee4d289106d60867d84cc9', 'request_id': 'req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.756880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:31.765706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] The token cache is being invalidate because project 4f9e3633a8ee4d289106d60867d84cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:31.766239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.767785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:31.774670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 866/1741] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:31 2022] DELETE /identity/v3/projects/4f9e3633a8ee4d289106d60867d84cc9 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:31.779064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:31.784112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:31.805337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 876/1742] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:31.807617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:31.833440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdeb0-fa8e-4944-9e96-0be8fa38ca1c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:31.836821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d676a1-a462-4b46-acc7-6a3e0ed0b578 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:31.843693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:31.844621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.844904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.845176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] PATH_INFO: `/v3/users/487fe1284211447baf4f96a91afd43bc` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.846628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=487fe1284211447baf4f96a91afd43bc)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:31.850775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:31.851504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:31.852454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.852752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.853044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.854004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:31.854529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:31.858745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:31.896856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 877/1743] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:31.900483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:31.931790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b46d-2a6a-46d0-9209-181f0bae420e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:31.953146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:31.957691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:31.959267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:31.960465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:31.961555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:31.967101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:32.002237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487fe1284211447baf4f96a91afd43bc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.020462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487fe1284211447baf4f96a91afd43bc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.021822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487fe1284211447baf4f96a91afd43bc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.024202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487fe1284211447baf4f96a91afd43bc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.056203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 878/1744] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:31 2022] POST /identity/v3/projects => generated 401 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:32.060427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:32.068421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:32.069277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487fe1284211447baf4f96a91afd43bc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.128414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 867/1745] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:31 2022] DELETE /identity/v3/users/487fe1284211447baf4f96a91afd43bc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:32.195632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b2d25-5c34-4810-a52d-af557899a13b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:32.268646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:32.269255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:32.269634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:32.269919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:32.270752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:32.273000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:32.292806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:32.295045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:32.321538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc16753-9971-45fa-a000-84adcc7740ca admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:32.322405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 879/1746] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:32 2022] POST /identity/v3/users => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:32.328126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:32.348288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:32.349779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:32.350300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:32.352037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] PATH_INFO: `/v3/projects/f75ea0329b0f4e119fe5b03f974f01bc` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:32.355600 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75ea0329b0f4e119fe5b03f974f01bc)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:32.362160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:32.364685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b53ff-7a95-473a-9501-fc7451f10499 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:32.366577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:32.383471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:32.387297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:32.390184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:32.391948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:32.392810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:32.401545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:32.432647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 880/1747] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:17:32.434053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:32.455038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b4bf2-e6cb-44b9-acd5-f901a4be54bc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:32.474883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:32.477086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:32.478318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:32.480250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:32.481276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:32.487968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:32.501218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75ea0329b0f4e119fe5b03f974f01bc', 'request_id': 'req-089b0065-1f62-432b-ae0e-e4d5d788f88f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.546901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75ea0329b0f4e119fe5b03f974f01bc', 'request_id': 'req-089b0065-1f62-432b-ae0e-e4d5d788f88f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.548407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 881/1748] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:32.550969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:32.565768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75ea0329b0f4e119fe5b03f974f01bc', 'request_id': 'req-089b0065-1f62-432b-ae0e-e4d5d788f88f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.658883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5112499-aeb9-4231-821e-c48a9761e22c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:32.709726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] The token cache is being invalidate because project f75ea0329b0f4e119fe5b03f974f01bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:32.709726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.751013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:32.762377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 868/1749] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:32 2022] DELETE /identity/v3/projects/f75ea0329b0f4e119fe5b03f974f01bc => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:32.765420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:32.769534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:32.837992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:32.974633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677b7ad-0912-4613-9b56-1ce315ae4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:32.975874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b7ad-0912-4613-9b56-1ce315ae4aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:32.979672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b7ad-0912-4613-9b56-1ce315ae4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:32.979672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677b7ad-0912-4613-9b56-1ce315ae4aff admin admin] PATH_INFO: `/v3/projects/2155db26350046a4a4fc453076d2a393/users/d35f72ea04c04e828bc1bbc3feb1cb71/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:32.979884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b0065-1f62-432b-ae0e-e4d5d788f88f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:32.985111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:32.986658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:32.987505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:32.988003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] PATH_INFO: `/v3/users/111bb6c0944e4f629f5d7799f4a86be6` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:32.990142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111bb6c0944e4f629f5d7799f4a86be6)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:32.993201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:33.020446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677b7ad-0912-4613-9b56-1ce315ae4aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2155db26350046a4a4fc453076d2a393, user_id=d35f72ea04c04e828bc1bbc3feb1cb71, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:33.023630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677b7ad-0912-4613-9b56-1ce315ae4aff admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:33.061159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 882/1750] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:32 2022] PUT /identity/v3/projects/2155db26350046a4a4fc453076d2a393/users/d35f72ea04c04e828bc1bbc3feb1cb71/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:33.072404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:33.073374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:33.081746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:33.175512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111bb6c0944e4f629f5d7799f4a86be6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.209022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111bb6c0944e4f629f5d7799f4a86be6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.211214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111bb6c0944e4f629f5d7799f4a86be6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.212657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111bb6c0944e4f629f5d7799f4a86be6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.252999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] MFA Rules not processed for user `d35f72ea04c04e828bc1bbc3feb1cb71`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:33.254349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:33.276273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111bb6c0944e4f629f5d7799f4a86be6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.312311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 869/1751] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:32 2022] DELETE /identity/v3/users/111bb6c0944e4f629f5d7799f4a86be6 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:33.318131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:33.322835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:33.389436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:33.412143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 883/1752] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:33.413306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:33.414933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:33.594331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b3ded-791e-4194-a5d2-c4d32d5d5142 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:33.610751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:33.612330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:33.612822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:33.613334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] PATH_INFO: `/v3/projects/544ef00bd2034b568b5408757038e9fc` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:33.618118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=544ef00bd2034b568b5408757038e9fc)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:33.621897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:33.631326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d70f5-7849-44e5-838b-1f4d632987e0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:33.648845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:33.650240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:33.650359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:33.650591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:33.655075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:33.661910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:33.730376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 884/1753] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:33 2022] POST /identity/v3/projects => generated 401 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:33.731413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544ef00bd2034b568b5408757038e9fc', 'request_id': 'req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.734372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:33.750385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544ef00bd2034b568b5408757038e9fc', 'request_id': 'req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.772089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544ef00bd2034b568b5408757038e9fc', 'request_id': 'req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.799612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] The token cache is being invalidate because project 544ef00bd2034b568b5408757038e9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:33.800403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.801361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1c2d8588-d4d6-4cea-bbdd-fcce16466d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:33.808148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 870/1754] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:33 2022] DELETE /identity/v3/projects/544ef00bd2034b568b5408757038e9fc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:33.810296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b17c8-c2d0-4bd3-b1dd-8240f9d1a54a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:33.810641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b17c8-c2d0-4bd3-b1dd-8240f9d1a54a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:33.811032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b17c8-c2d0-4bd3-b1dd-8240f9d1a54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:33.815390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:33.850789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ae9b17c8-c2d0-4bd3-b1dd-8240f9d1a54a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:33.865047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ae9b17c8-c2d0-4bd3-b1dd-8240f9d1a54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:33.902058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f715e-f55f-458e-ab72-18232fa198f8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:33.912400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:33.913834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:33.916887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:33.918185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:33.919895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:33.940537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.002819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 885/1755] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:33 2022] POST /identity/v3/users => generated 307 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:34.008404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.020831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 871/1756] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:34.022699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:34.032483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.033392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.033698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.058198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c6ddb-6b4d-4dfb-99ef-fe009dcf9057 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.081176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:34.082516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:34.089712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.090476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.090764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.091042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.091819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.093714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.116656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 872/1757] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:34.119382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.137488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 886/1758] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:34.141508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.146829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a2c41-514a-4c17-b98d-519beb7ca5c8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.176287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.176742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6075aa-66a6-49bb-896d-74c8328237e9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.177381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.177665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.177945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.178687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:34.178998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.180935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.196834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.204089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.204394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.204673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] PATH_INFO: `/v3/projects/3473649b9b934b0bb68a7112d7f62a53/users/a5ac2de3e7f349d4a5973051cf9c65f1/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.209098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 873/1759] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:34.216327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.250280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1384d-84bd-4d14-9f1e-fd0c1946ed2f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.257549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] RBAC: Authorizing `identity:create_grant(project_id=3473649b9b934b0bb68a7112d7f62a53, user_id=a5ac2de3e7f349d4a5973051cf9c65f1, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.260650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.260982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.262408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.262965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.263739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.264793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.267556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.297452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 887/1760] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:34 2022] PUT /identity/v3/projects/3473649b9b934b0bb68a7112d7f62a53/users/a5ac2de3e7f349d4a5973051cf9c65f1/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:34.303348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.324134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:34.347403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 874/1761] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:34 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:34.348546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.472642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36330a26-bde9-494d-ad41-74daedff9add admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.509290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cade1e-dd05-4d1e-bdf7-c040c4cac025 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.514910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.516048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.516707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.517055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.518434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.522818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.567824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 875/1762] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:34 2022] POST /identity/v3/users => generated 284 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:34.570968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.625525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00d326-a291-43f5-9b64-29bc17d75eef admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.639678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.640814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.642007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.642007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.642703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.646564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.662223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.662917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.663224 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.663498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.664235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.665035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 876/1763] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:34.671964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.686196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.686398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a453402-f3a5-4f63-a94b-ebbb4fa946a2 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.692631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.693810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.694156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.694490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.695639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.697418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.706982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 888/1764] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:34.711590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.726812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 877/1765] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:34.727939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:34.748190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0e41e-cb1b-4af9-9580-cca15ba0427e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.757797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2edb9-87c4-41d4-a22b-77e4330a5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.758801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2edb9-87c4-41d4-a22b-77e4330a5dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.759142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2edb9-87c4-41d4-a22b-77e4330a5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.759280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9778f64-a528-48f4-9536-6e3f4b9f20fb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:34.759575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2edb9-87c4-41d4-a22b-77e4330a5dfe admin admin] PATH_INFO: `/v3/projects/5e74c6d141804704b7c3ab586efeb7d4/users/1d13d2b377a8481ab670cc291d7f756c/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.776497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8be88-afc6-4d27-9097-db44ed8abe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:34.777430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8be88-afc6-4d27-9097-db44ed8abe91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.777712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8be88-afc6-4d27-9097-db44ed8abe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.777986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8be88-afc6-4d27-9097-db44ed8abe91 admin admin] PATH_INFO: `/v3/projects/3473649b9b934b0bb68a7112d7f62a53/users/a5ac2de3e7f349d4a5973051cf9c65f1/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.784088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2edb9-87c4-41d4-a22b-77e4330a5dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e74c6d141804704b7c3ab586efeb7d4, user_id=1d13d2b377a8481ab670cc291d7f756c, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.791185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2edb9-87c4-41d4-a22b-77e4330a5dfe admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.792655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8be88-afc6-4d27-9097-db44ed8abe91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3473649b9b934b0bb68a7112d7f62a53, user_id=a5ac2de3e7f349d4a5973051cf9c65f1, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:34.795508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8be88-afc6-4d27-9097-db44ed8abe91 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:34.833237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 878/1766] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:34 2022] PUT /identity/v3/projects/5e74c6d141804704b7c3ab586efeb7d4/users/1d13d2b377a8481ab670cc291d7f756c/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:34.835435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.835760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.836152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.842298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 889/1767] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:34 2022] PUT /identity/v3/projects/3473649b9b934b0bb68a7112d7f62a53/users/a5ac2de3e7f349d4a5973051cf9c65f1/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:34.854033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:34.854356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:34.854711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:34.902051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:34.917809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] MFA Rules not processed for user `a5ac2de3e7f349d4a5973051cf9c65f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:34.919129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:34.924897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] MFA Rules not processed for user `1d13d2b377a8481ab670cc291d7f756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:34.927920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:35.155618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 890/1768] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:35.164404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:35.166190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:35.186908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 879/1769] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:35.191393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:35.284454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:35.307051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e9135-3450-486f-8dfa-0b2c84947e7f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:35.317104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:35.317786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.318065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.318344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:35.344245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:35.345726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:35.363076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 891/1770] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:35.403824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42f963-8e8f-4a1e-a4dc-3b5678a43ee9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:35.415364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:35.416268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.416865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.417140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:35.417874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:35.419984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:35.501604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 880/1771] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:35 2022] POST /identity/v3/projects => generated 365 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:35.506286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:35.520697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364f6b6-c8c4-471a-a6e4-b0cf9fd229f0 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:35.551363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:35.682418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:35.683140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.683480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.683758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:35.684525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:35.689096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:35.692168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09c25b-d043-486f-9dca-97d8c2055b41 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:35.703475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:35.704698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.705131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.706127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:35.710726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:35.755685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 892/1772] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:35 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:35.755685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:35.785889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570f46b-c241-4dbf-aa19-cbd5a6492a7e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:35.798357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace16b-876f-47b4-b554-95245f5d2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:35.799718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace16b-876f-47b4-b554-95245f5d2a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.801796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace16b-876f-47b4-b554-95245f5d2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.802855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace16b-876f-47b4-b554-95245f5d2a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:35.804890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace16b-876f-47b4-b554-95245f5d2a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:35.809722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace16b-876f-47b4-b554-95245f5d2a1b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:35.866993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 893/1773] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:35.866993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919257-f4f4-499d-8f66-bba64e5506f2 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.866993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919257-f4f4-499d-8f66-bba64e5506f2 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.867557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919257-f4f4-499d-8f66-bba64e5506f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:35.917162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:35.922473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:35.927517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7e919257-f4f4-499d-8f66-bba64e5506f2 None None] MFA Rules not processed for user `829c30cd914f48548b987bd6e39ee774`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:35.929651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7e919257-f4f4-499d-8f66-bba64e5506f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:35.948287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 881/1774] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:35.949229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:35.976695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:35.981391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ac3e4-1574-4c36-8d1e-1a47302d48a2 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:35.986955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:35.987904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:35.988323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:35.989377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] PATH_INFO: `/v3/projects/f170d378ddf04e708134edfcae67ecc0/users/86c943d17f034c0fbedb3cf4073fb3b4/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.024904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f170d378ddf04e708134edfcae67ecc0, user_id=86c943d17f034c0fbedb3cf4073fb3b4, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:36.027837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:36.061278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 882/1775] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:35 2022] PUT /identity/v3/projects/f170d378ddf04e708134edfcae67ecc0/users/86c943d17f034c0fbedb3cf4073fb3b4/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:36.081282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:36.124990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 894/1776] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:36.148900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95918c9-ca13-4cce-8464-a13f1e3ea93e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.149446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95918c9-ca13-4cce-8464-a13f1e3ea93e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:36.149836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95918c9-ca13-4cce-8464-a13f1e3ea93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.204350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b95918c9-ca13-4cce-8464-a13f1e3ea93e None None] MFA Rules not processed for user `e4e4d39c5ed249bc9dc097ba4c24b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:36.205585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b95918c9-ca13-4cce-8464-a13f1e3ea93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:36.253718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:36.313023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02e90a-d122-4940-88a6-5d748c0ed9b4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:36.328381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:36.329222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.329505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:36.329781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.330664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:36.332192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:36.360188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 883/1777] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:36.365401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:36.380230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 895/1778] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:36.390959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56403349-559f-4729-a487-b13b1faa9ece admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:36.406074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:36.408503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.409435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:36.410406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] PATH_INFO: `/v3/projects/f170d378ddf04e708134edfcae67ecc0/users/86c943d17f034c0fbedb3cf4073fb3b4/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.415518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f170d378ddf04e708134edfcae67ecc0, user_id=86c943d17f034c0fbedb3cf4073fb3b4, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:36.422215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:36.449455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 884/1779] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:36 2022] PUT /identity/v3/projects/f170d378ddf04e708134edfcae67ecc0/users/86c943d17f034c0fbedb3cf4073fb3b4/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:36.462480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e91e0-3c09-44ba-b242-c04e4190b765 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.462769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e91e0-3c09-44ba-b242-c04e4190b765 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:36.463041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e91e0-3c09-44ba-b242-c04e4190b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.509911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2c6e91e0-3c09-44ba-b242-c04e4190b765 None None] MFA Rules not processed for user `86c943d17f034c0fbedb3cf4073fb3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:36.512052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2c6e91e0-3c09-44ba-b242-c04e4190b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:36.760088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 896/1780] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:36.772367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:36.803728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65126-de22-4f6d-b37b-e3de5647c359 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.805571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65126-de22-4f6d-b37b-e3de5647c359 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:36.805571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc65126-de22-4f6d-b37b-e3de5647c359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.845373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0bc65126-de22-4f6d-b37b-e3de5647c359 None None] MFA Rules not processed for user `99e8bd308e5549618c66d6edaf02523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:36.848934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0bc65126-de22-4f6d-b37b-e3de5647c359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:36.886499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491a7a-821a-4931-9676-3c121b3f7bc9 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:36.911674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:36.912429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.912630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:36.914517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:36.933066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:36.935116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:36.947067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 885/1781] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:36.959436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:36.963897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:36.994725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 897/1782] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:36.998960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:36.999595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.002482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.018821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:37.050478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] MFA Rules not processed for user `06ba885a0b164134898c42a332feba76`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:37.054332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:37.145010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de2b41-ca21-46f2-9327-95d5922f2659 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:37.158189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:37.159094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.159545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.159822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] PATH_INFO: `/v3/projects/0ab7bf7599ad4630b913b63544929d9c` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.161075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab7bf7599ad4630b913b63544929d9c)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:37.163037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:37.218924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 898/1783] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:37.224555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:37.231850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7ec1-fbcc-4f36-a920-8aee155de37c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:37.237764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a987327-6e39-4dfe-b96d-f0e4bf6da27d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:37.238599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987327-6e39-4dfe-b96d-f0e4bf6da27d service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.238891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987327-6e39-4dfe-b96d-f0e4bf6da27d service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.239269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a987327-6e39-4dfe-b96d-f0e4bf6da27d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.268894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab7bf7599ad4630b913b63544929d9c', 'request_id': 'req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:37.280625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab7bf7599ad4630b913b63544929d9c', 'request_id': 'req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:37.293976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab7bf7599ad4630b913b63544929d9c', 'request_id': 'req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:37.321522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] The token cache is being invalidate because project 0ab7bf7599ad4630b913b63544929d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:37.321815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:37.323285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:37.333442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 886/1784] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:36 2022] DELETE /identity/v3/projects/0ab7bf7599ad4630b913b63544929d9c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:37.333442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:37.333730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:37.345478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:37.349324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a987327-6e39-4dfe-b96d-f0e4bf6da27d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:37.351352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a987327-6e39-4dfe-b96d-f0e4bf6da27d service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:37.403567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 899/1785] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:37.407989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f73d-fc0f-4279-983e-e19677189530 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.408181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f73d-fc0f-4279-983e-e19677189530 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.408562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069f73d-fc0f-4279-983e-e19677189530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.425909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc8a04-5d92-48e8-8f39-c1a509e7d2f9 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:37.435794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:37.436615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.436942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.437969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.440274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:37.454878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:37.456559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5028cb-525f-4077-92b4-2a25d10d5423 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:37.458266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6069f73d-fc0f-4279-983e-e19677189530 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:37.463214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6069f73d-fc0f-4279-983e-e19677189530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:37.467723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 887/1786] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:37.578868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.579191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.579759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.607672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] MFA Rules not processed for user `a0c9f3f10fd142439521e4b36cf33157`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:37.609299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:37.650672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 900/1787] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:37.665315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.665608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.665892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.713507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:37.714895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:37.727764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 888/1788] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:37.743812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 901/1789] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:37.763697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:37.807575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45f88b-1fb2-45ab-94b3-54bc0ce09f1d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:37.844503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:37.846719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.847235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.848164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.852698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:37.853833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:37.859925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:37.900431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 889/1790] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:37.906385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:37.926608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785cb9b-4b04-447a-99c0-851ba551b536 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:37.943769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:37.944560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:37.944843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:37.945110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:37.951299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:37.959809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:38.042951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 902/1791] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:37 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:38.047572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:38.060980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794da52-c545-43e5-bc5a-69072ea74c81 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:38.225487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:38.226349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:38.226874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:38.227277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:38.228089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:38.230137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:38.287110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 890/1792] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:38 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:38.287957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:38.306613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87df86-cd77-4e3e-82eb-750fcc36b91e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:38.315335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:38.316291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:38.316729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:38.317146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:38.318921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:38.324882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:38.344072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 903/1793] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:38.348432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:38.359195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f054-5351-4b5b-b784-996c3b422b76 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:38.367030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34138064-3842-43bf-bf14-b778afcd7d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:38.368030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34138064-3842-43bf-bf14-b778afcd7d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:38.368471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34138064-3842-43bf-bf14-b778afcd7d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:38.368748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34138064-3842-43bf-bf14-b778afcd7d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:38.369490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34138064-3842-43bf-bf14-b778afcd7d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:38.371186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34138064-3842-43bf-bf14-b778afcd7d72 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:38.385871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 891/1794] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:38.389849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:38.419388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e60c4f-60f0-499d-bc7f-7b8b0e549abb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:38.432165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:38.434962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:38.436242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:38.436578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] PATH_INFO: `/v3/projects/39d5beeca9484debbfe9e21e96568cec/users/156428fbe8ef452d84ad861692dbf370/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:38.439519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:38.467911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d5beeca9484debbfe9e21e96568cec, user_id=156428fbe8ef452d84ad861692dbf370, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:38.471026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:38.507347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 904/1795] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:38 2022] PUT /identity/v3/projects/39d5beeca9484debbfe9e21e96568cec/users/156428fbe8ef452d84ad861692dbf370/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:38.511754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:38.512241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:38.512428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:38.553101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] MFA Rules not processed for user `156428fbe8ef452d84ad861692dbf370`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:38.554621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:38.560452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:38.669641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 892/1796] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:38.671037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:38.805119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51dcf0-62b9-4c39-aa1f-9e99622639b8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:38.817236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:38.817236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:38.817236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:38.818347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:38.820368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:38.823309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:38.871197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 905/1797] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:38 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:38.873057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:38.890812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe84d62-c891-445c-b786-5875fbe6d9c7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:39.021904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:39.022688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:39.023527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:39.023930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:39.024854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:39.027115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:39.062082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 893/1798] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:38 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:39.072660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:39.096168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a9742-b1d6-456b-b6bf-7ee35e9eaacd admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:39.137938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:39.147016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:39.147016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:39.147016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:39.150364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:39.153134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:39.210759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 906/1799] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:39.214953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:39.237156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52693d-5594-417e-920b-9fded9749dde admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:39.268583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:39.273799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:39.274090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:39.274368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] PATH_INFO: `/v3/projects/e4970e9ac0a142cc91fab50626113095/users/25a86e04f92d4868ad963de9c4689a11/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:39.299703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4970e9ac0a142cc91fab50626113095, user_id=25a86e04f92d4868ad963de9c4689a11, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:39.304714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:39.333255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 894/1800] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:39 2022] PUT /identity/v3/projects/e4970e9ac0a142cc91fab50626113095/users/25a86e04f92d4868ad963de9c4689a11/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:39.337775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:39.357171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879975e8-dddf-42ab-b6dc-67a44712002c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:39.467713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeaa9d4-b367-43d3-ad86-89abe2399f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:39.468616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa9d4-b367-43d3-ad86-89abe2399f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:39.469029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa9d4-b367-43d3-ad86-89abe2399f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:39.469586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeaa9d4-b367-43d3-ad86-89abe2399f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:39.470632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaa9d4-b367-43d3-ad86-89abe2399f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:39.473458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeaa9d4-b367-43d3-ad86-89abe2399f5d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:39.488526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 907/1801] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:39.492799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:39.513325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aca63f-2f0e-4554-b23e-4c62cbc6f3d2 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:39.525627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:39.528734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:39.529199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:39.530889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] PATH_INFO: `/v3/projects/e4970e9ac0a142cc91fab50626113095/users/25a86e04f92d4868ad963de9c4689a11/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:39.537160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4970e9ac0a142cc91fab50626113095, user_id=25a86e04f92d4868ad963de9c4689a11, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:39.545010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:39.582290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 895/1802] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:39 2022] PUT /identity/v3/projects/e4970e9ac0a142cc91fab50626113095/users/25a86e04f92d4868ad963de9c4689a11/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:39.585385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:39.585675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:39.585998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:39.637525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] MFA Rules not processed for user `25a86e04f92d4868ad963de9c4689a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:39.639192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:39.764393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:39.865265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 908/1803] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:40.010712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:40.012924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:40.179750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273f1f-639b-4a4e-bc02-99fd723442d4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:40.186134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:40.187333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:40.187914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:40.188409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:40.207529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:40.210656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:40.218914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:40.246576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 896/1804] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:40.391239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:40.409720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f5a4-0c29-43e2-acf2-6d22da101ae0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:40.420761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6949-acb8-42c2-bac3-d85835984fd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:40.421796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6949-acb8-42c2-bac3-d85835984fd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:40.423094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6949-acb8-42c2-bac3-d85835984fd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:40.423531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6949-acb8-42c2-bac3-d85835984fd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:40.619237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c6949-acb8-42c2-bac3-d85835984fd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:40.620911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c6949-acb8-42c2-bac3-d85835984fd0 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:40.662649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 909/1805] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:41.554330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:41.556200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:41.733360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a0fd-e555-46a6-a262-e036a15a21cc service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:41.739429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:41.740630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:41.741110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:41.741628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] PATH_INFO: `/v3/users/d35f72ea04c04e828bc1bbc3feb1cb71` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:41.743194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35f72ea04c04e828bc1bbc3feb1cb71)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:41.745663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:41.842452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35f72ea04c04e828bc1bbc3feb1cb71'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:41.866253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35f72ea04c04e828bc1bbc3feb1cb71'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:41.866856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35f72ea04c04e828bc1bbc3feb1cb71'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:41.867501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35f72ea04c04e828bc1bbc3feb1cb71'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:41.888663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35f72ea04c04e828bc1bbc3feb1cb71'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:41.931868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 897/1806] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:41 2022] DELETE /identity/v3/users/d35f72ea04c04e828bc1bbc3feb1cb71 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:41.936654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db071a-79b3-4d14-a71c-6796adf090f0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:41.937119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db071a-79b3-4d14-a71c-6796adf090f0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:41.937210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db071a-79b3-4d14-a71c-6796adf090f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:41.999362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-44db071a-79b3-4d14-a71c-6796adf090f0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:42.005598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-44db071a-79b3-4d14-a71c-6796adf090f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:42.158283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 910/1807] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:42.186006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:42.187667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:42.407030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d19ed6-6f95-4d98-bc6e-00740da4b9d6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:42.411648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052950-d3eb-4717-9328-f4dab221934b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:42.412508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052950-d3eb-4717-9328-f4dab221934b service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:42.412880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052950-d3eb-4717-9328-f4dab221934b service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:42.413248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052950-d3eb-4717-9328-f4dab221934b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:42.432095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73052950-d3eb-4717-9328-f4dab221934b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:42.436206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73052950-d3eb-4717-9328-f4dab221934b service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:42.458803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 898/1808] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:43.770188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088053-8833-477e-9692-15548cef6fbd None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:43.771300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088053-8833-477e-9692-15548cef6fbd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:43.771776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55088053-8833-477e-9692-15548cef6fbd None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:43.773682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 911/1809] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:17:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:17:43.812722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d419-c85e-4405-abf1-0d141a1f3527 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:43.813537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d419-c85e-4405-abf1-0d141a1f3527 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:43.813982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d419-c85e-4405-abf1-0d141a1f3527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:43.867210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b653d419-c85e-4405-abf1-0d141a1f3527 None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:43.872010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b653d419-c85e-4405-abf1-0d141a1f3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:43.922183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:44.037822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 899/1810] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:44.327812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088053-8833-477e-9692-15548cef6fbd None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:44.331934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-55088053-8833-477e-9692-15548cef6fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:44.360184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55088053-8833-477e-9692-15548cef6fbd None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:44.368534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:44.369948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:44.372836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:44.373348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] PATH_INFO: `/v3/users/1d13d2b377a8481ab670cc291d7f756c` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:44.376566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d13d2b377a8481ab670cc291d7f756c)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:44.380059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:44.522160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d13d2b377a8481ab670cc291d7f756c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:44.529838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d13d2b377a8481ab670cc291d7f756c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:44.531614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d13d2b377a8481ab670cc291d7f756c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:44.552869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d13d2b377a8481ab670cc291d7f756c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:44.581772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d13d2b377a8481ab670cc291d7f756c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:44.583694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:44.611512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 912/1811] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:44 2022] DELETE /identity/v3/users/1d13d2b377a8481ab670cc291d7f756c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:44.616341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:44.616633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:44.616912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:44.647414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:44.648667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:44.734555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 900/1812] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:44.753512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:44.755178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:44.831531 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48c732-891a-42cd-868c-c8ee4126b350 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:44.838147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:44.838974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:44.839376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:44.839739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:44.851011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:44.852658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:44.871368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 913/1813] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:45.148348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:45.150176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:45.169104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf5e2e-b084-4462-ad95-bacc17ca548a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:45.176115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:45.177152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:45.177654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:45.178472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] PATH_INFO: `/v3/projects/2155db26350046a4a4fc453076d2a393` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:45.180225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2155db26350046a4a4fc453076d2a393)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:45.183123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:45.250128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:45.255651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:45.282070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2155db26350046a4a4fc453076d2a393', 'request_id': 'req-8f377d17-cc1b-4416-85e9-4557005fa17e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.290912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2155db26350046a4a4fc453076d2a393', 'request_id': 'req-8f377d17-cc1b-4416-85e9-4557005fa17e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.307541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2155db26350046a4a4fc453076d2a393', 'request_id': 'req-8f377d17-cc1b-4416-85e9-4557005fa17e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.350543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] The token cache is being invalidate because project 2155db26350046a4a4fc453076d2a393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:45.350941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.351950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.353899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 901/1814] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:45 2022] DELETE /identity/v3/projects/2155db26350046a4a4fc453076d2a393 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:45.358721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:45.374042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:45.378825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fab158-8885-430c-bc29-00f481cad415 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:45.493632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:45.495787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:45.499434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:45.499878 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:45.502689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:45.508808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:45.531348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:45.533809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34634aad-8c6e-4afa-83d1-02ecca934e7d service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:45.561899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 914/1815] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:45.563333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f377d17-cc1b-4416-85e9-4557005fa17e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:45.568748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:45.569885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:45.570323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:45.570759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] PATH_INFO: `/v3/users/a5ac2de3e7f349d4a5973051cf9c65f1` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:45.572183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ac2de3e7f349d4a5973051cf9c65f1)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:45.574510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:45.584958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cf9a2-2821-4b72-a7a4-5c1e01b268b8 None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:45.585458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cf9a2-2821-4b72-a7a4-5c1e01b268b8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:45.585891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cf9a2-2821-4b72-a7a4-5c1e01b268b8 None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:45.587581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 915/1816] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:17:45.609937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:45.610595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:45.611049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:45.670474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ac2de3e7f349d4a5973051cf9c65f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.686271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:45.688593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:45.693689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ac2de3e7f349d4a5973051cf9c65f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.694409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ac2de3e7f349d4a5973051cf9c65f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.695062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ac2de3e7f349d4a5973051cf9c65f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.701381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 916/1817] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:17:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:45.711978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ac2de3e7f349d4a5973051cf9c65f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:45.725267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:45.727025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:45.741419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 902/1818] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:45 2022] DELETE /identity/v3/users/a5ac2de3e7f349d4a5973051cf9c65f1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:45.744664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9648dab-53ee-45af-98ef-b5e04b7b6e8e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:45.759628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:45.822608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:45.823577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:45.823882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:45.824463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:45.836598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:45.838622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:45.853881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 917/1819] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:46.009583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.011225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.105512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.110642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.126584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab81cb9-0a79-4977-a38a-968cec1e4d00 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.131710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.132628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.132910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.133302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] PATH_INFO: `/v3/projects/5e74c6d141804704b7c3ab586efeb7d4` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.134415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e74c6d141804704b7c3ab586efeb7d4)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.136431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.143780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fbac2-a3fa-498d-a6a7-76011e1c8710 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.149147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.150033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.150351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.150619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] PATH_INFO: `/v3/projects/3473649b9b934b0bb68a7112d7f62a53` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.151821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] RBAC: Authorizing `identity:delete_project(project_id=3473649b9b934b0bb68a7112d7f62a53)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.153689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.190610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e74c6d141804704b7c3ab586efeb7d4', 'request_id': 'req-b36c0b6a-2db1-46ee-a428-d19bbb89e846'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.197559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e74c6d141804704b7c3ab586efeb7d4', 'request_id': 'req-b36c0b6a-2db1-46ee-a428-d19bbb89e846'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.201489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:46.204123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3473649b9b934b0bb68a7112d7f62a53', 'request_id': 'req-4b0181cc-330c-4d38-b46d-5272f7f324df'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.204291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e74c6d141804704b7c3ab586efeb7d4', 'request_id': 'req-b36c0b6a-2db1-46ee-a428-d19bbb89e846'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.211692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3473649b9b934b0bb68a7112d7f62a53', 'request_id': 'req-4b0181cc-330c-4d38-b46d-5272f7f324df'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.218867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3473649b9b934b0bb68a7112d7f62a53', 'request_id': 'req-4b0181cc-330c-4d38-b46d-5272f7f324df'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.222739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] The token cache is being invalidate because project 5e74c6d141804704b7c3ab586efeb7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:46.223851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.224837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.227438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 903/1820] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:46 2022] DELETE /identity/v3/projects/5e74c6d141804704b7c3ab586efeb7d4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:46.231003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.232539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.237313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] The token cache is being invalidate because project 3473649b9b934b0bb68a7112d7f62a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:46.237609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.238316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4b0181cc-330c-4d38-b46d-5272f7f324df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.250907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 918/1821] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:46 2022] DELETE /identity/v3/projects/3473649b9b934b0bb68a7112d7f62a53 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:46.262112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf95ae3-5f6e-47b7-88da-217476f20dfb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.262404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf95ae3-5f6e-47b7-88da-217476f20dfb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.262685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf95ae3-5f6e-47b7-88da-217476f20dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.292117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7bf95ae3-5f6e-47b7-88da-217476f20dfb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:46.294447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7bf95ae3-5f6e-47b7-88da-217476f20dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.310492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0b6a-2db1-46ee-a428-d19bbb89e846 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.361123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 919/1822] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:46.370960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.370960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.371257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.380776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.381762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.382112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.382450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] PATH_INFO: `/v3/users/86c943d17f034c0fbedb3cf4073fb3b4` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.383771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c943d17f034c0fbedb3cf4073fb3b4)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.385793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.393794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:46.396722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.407818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 920/1823] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:46.412246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.423718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1bbfaa-ca55-4ca4-950f-f057eb00ce92 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.429104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.429821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.430198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.430432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.431198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:46.431539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.433315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.443209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:46.454248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c943d17f034c0fbedb3cf4073fb3b4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.456556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 921/1824] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:17:46.461618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.468300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c943d17f034c0fbedb3cf4073fb3b4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.469370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c943d17f034c0fbedb3cf4073fb3b4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.469772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c943d17f034c0fbedb3cf4073fb3b4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.473632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2137b-3388-4353-af28-c8f9dc41a4e0 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.479493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.480290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.480637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.481010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.481797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.483812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.486222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c943d17f034c0fbedb3cf4073fb3b4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:46.500731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 904/1825] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:46 2022] DELETE /identity/v3/users/86c943d17f034c0fbedb3cf4073fb3b4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:46.520402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 922/1826] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:46 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:46.523984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.525389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.542809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:46.611061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672f33-691e-4aff-8a03-caa884b09046 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.673451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.674127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.674403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.674671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.675461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.677471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.698690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 905/1827] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:46 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:46.703007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.716947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fe467-53c1-4423-a78f-371836f7bc41 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.722756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.723844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.724156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.724403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.725135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.726757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.738060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 923/1828] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:46.742051 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.753193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e82c0-40b9-4d34-8c0f-45bde2e9534f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.758758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a812ec-1088-47bc-aeab-9a782c4ae1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.759515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a812ec-1088-47bc-aeab-9a782c4ae1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.759800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a812ec-1088-47bc-aeab-9a782c4ae1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.760072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a812ec-1088-47bc-aeab-9a782c4ae1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.761159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a812ec-1088-47bc-aeab-9a782c4ae1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.762772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a812ec-1088-47bc-aeab-9a782c4ae1eb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.773905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 906/1829] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:46.777902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.789956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a7d4f-0060-4db9-99cc-744f61efa5dc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:46.795336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:46.795743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.796229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.796524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] PATH_INFO: `/v3/projects/b9fe1710c4aa406fb9632109d9ed6a3e/users/601f6087df304d3898aee099d8a98228/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.812630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fe1710c4aa406fb9632109d9ed6a3e, user_id=601f6087df304d3898aee099d8a98228, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:46.815334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:46.832762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 924/1830] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:46 2022] PUT /identity/v3/projects/b9fe1710c4aa406fb9632109d9ed6a3e/users/601f6087df304d3898aee099d8a98228/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:46.844448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:46.844930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:46.845398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:46.877400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] MFA Rules not processed for user `601f6087df304d3898aee099d8a98228`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:46.878955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.917364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.919720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:46.977892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 907/1831] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:46.990121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:46.992140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:47.006213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865c153-198f-4055-9fec-5aed618e42fe admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.012001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.012887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.013195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.013466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] PATH_INFO: `/v3/projects/f170d378ddf04e708134edfcae67ecc0` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.014700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f170d378ddf04e708134edfcae67ecc0)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.017166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.031058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:47.058440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82c6e3-b1a8-42a3-b967-af99d298380c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.062297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6def32-1fcc-461d-83ea-18a0cbd7d3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.063802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6def32-1fcc-461d-83ea-18a0cbd7d3ba service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.063802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6def32-1fcc-461d-83ea-18a0cbd7d3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.063802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6def32-1fcc-461d-83ea-18a0cbd7d3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.072411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6def32-1fcc-461d-83ea-18a0cbd7d3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.073860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6def32-1fcc-461d-83ea-18a0cbd7d3ba service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.083205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 908/1832] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:47.089749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f170d378ddf04e708134edfcae67ecc0', 'request_id': 'req-73f23f1c-909e-4fa2-ad12-55641dc4e548'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:47.095910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f170d378ddf04e708134edfcae67ecc0', 'request_id': 'req-73f23f1c-909e-4fa2-ad12-55641dc4e548'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:47.101451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f170d378ddf04e708134edfcae67ecc0', 'request_id': 'req-73f23f1c-909e-4fa2-ad12-55641dc4e548'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:47.115311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] The token cache is being invalidate because project f170d378ddf04e708134edfcae67ecc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:47.115673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:47.116397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-73f23f1c-909e-4fa2-ad12-55641dc4e548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:47.118108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 925/1833] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:46 2022] DELETE /identity/v3/projects/f170d378ddf04e708134edfcae67ecc0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:47.123021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.123400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.123743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.142342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:47.143749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:47.203540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 909/1834] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:47.211821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.212039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.212371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.232876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:47.234404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:47.244027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 926/1835] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:47.248686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.259401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc54c-0f5e-4881-bfe2-4de07e1636c8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.264368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.265179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.265277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.265556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.266281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:47.266586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.268431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.286071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 910/1836] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:17:47.291176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.304264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f44b-5cd7-4a9f-b086-f4c372271f6a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.311781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.313128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.313533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.313828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.315078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.317414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.395406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 927/1837] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:47 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:47.400495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.435181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756feeed-2c3c-4370-ab3e-6e6c95c2f5f9 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.524874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.525754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.526146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.526520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.527424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.529868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.561232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 911/1838] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:47 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:47.562639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.568986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:47.576868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52cc05-3762-4ba5-b2b2-924e5d93b292 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.585752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.587175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.587791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.588106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.588926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.590978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.602444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 928/1839] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:47.606487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.617955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4394a-dc30-45a6-98f6-f3940cd92951 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.622763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65534f5e-ea93-40dc-9fe3-2b8b418ca257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.623568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534f5e-ea93-40dc-9fe3-2b8b418ca257 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.623920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534f5e-ea93-40dc-9fe3-2b8b418ca257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.624265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65534f5e-ea93-40dc-9fe3-2b8b418ca257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.625305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65534f5e-ea93-40dc-9fe3-2b8b418ca257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.627024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65534f5e-ea93-40dc-9fe3-2b8b418ca257 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.640854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 912/1840] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:47.645780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.679490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9dbcef-750b-429f-910a-57be4cbb80f4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.685413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.686568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.686928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.687385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] PATH_INFO: `/v3/projects/65159cf73c344ca09e12119ed1b2e6a7/users/2c8319d920344eeea83bb8f072ff2f42/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.706804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65159cf73c344ca09e12119ed1b2e6a7, user_id=2c8319d920344eeea83bb8f072ff2f42, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.709304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.727333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 929/1841] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:47 2022] PUT /identity/v3/projects/65159cf73c344ca09e12119ed1b2e6a7/users/2c8319d920344eeea83bb8f072ff2f42/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:47.732487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84bf1-bc7e-470e-a38a-727d8eb717ab None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.733056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84bf1-bc7e-470e-a38a-727d8eb717ab None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.733843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b84bf1-bc7e-470e-a38a-727d8eb717ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.754215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-08b84bf1-bc7e-470e-a38a-727d8eb717ab None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:47.755458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-08b84bf1-bc7e-470e-a38a-727d8eb717ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:47.802935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:47.845045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 913/1842] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:47.872202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:47.874015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:47.940488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69c04b-f7ca-4255-a9cd-3c3df292868d admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:47.946842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:47.946842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:47.947239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:47.948144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:47.958418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:47.960646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:47.971946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 930/1843] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:49.194199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.194715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.194790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.222339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] MFA Rules not processed for user `2c8319d920344eeea83bb8f072ff2f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:49.223588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:49.307937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 914/1844] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:49.308264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:49.322831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72915bfa-519c-42e6-a2d5-b134b23b10b9 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:49.337611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:49.338801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.338801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.339114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.339658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:49.341599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:49.391942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 931/1845] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:49 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:49.396574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:49.410419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58d53-5d7b-4bd3-900e-5e171a309dd4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:49.473730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:49.474540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.474955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.475271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.476255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:49.477974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:49.507166 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 915/1846] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:49 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:49.508182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:49.520490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bf3f-140f-46b1-b0cb-0e2f6a824cb1 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:49.526437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:49.527128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.527440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.527685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.528973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:49.530454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:49.544734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 932/1847] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:17:49.548700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:49.562535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df666-b409-4b77-8c85-3e7d16c6878d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:49.569452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:49.570488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.570871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.571330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] PATH_INFO: `/v3/projects/03bd081c73f446218d45d02dd7230aaf/users/4b40ab67110147d0aca75380b808b7a1/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.590550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bd081c73f446218d45d02dd7230aaf, user_id=4b40ab67110147d0aca75380b808b7a1, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:49.593421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:49.623245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 916/1848] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:49 2022] PUT /identity/v3/projects/03bd081c73f446218d45d02dd7230aaf/users/4b40ab67110147d0aca75380b808b7a1/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:49.624381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:49.644366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31f6c-a572-452b-9c38-a877f6870962 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:49.752938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdee50-7283-4b5e-961f-93d1813515e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:49.754246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdee50-7283-4b5e-961f-93d1813515e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.754896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdee50-7283-4b5e-961f-93d1813515e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.755635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdee50-7283-4b5e-961f-93d1813515e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.756842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdee50-7283-4b5e-961f-93d1813515e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:49.761919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdee50-7283-4b5e-961f-93d1813515e6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:49.777620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 933/1849] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:49.781291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:49.807373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da5a3a-6c50-442a-befa-77aa5c5bd01c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:49.817645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:49.818565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:49.818845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:49.819121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] PATH_INFO: `/v3/projects/03bd081c73f446218d45d02dd7230aaf/users/4b40ab67110147d0aca75380b808b7a1/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:49.826520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bd081c73f446218d45d02dd7230aaf, user_id=4b40ab67110147d0aca75380b808b7a1, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:49.829425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:49.850680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 917/1850] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:49 2022] PUT /identity/v3/projects/03bd081c73f446218d45d02dd7230aaf/users/4b40ab67110147d0aca75380b808b7a1/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:50.780825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:50.781389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:50.781389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:50.814268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] MFA Rules not processed for user `4b40ab67110147d0aca75380b808b7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:50.815667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:50.846332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:50.924697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 934/1851] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:50.934145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:50.936543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:50.961252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:50.999332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa34060-b6ba-4a37-9b91-ef663e1dfedb admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:51.003929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076000f-a797-420c-ba10-394580df708b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:51.004936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076000f-a797-420c-ba10-394580df708b service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:51.005287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076000f-a797-420c-ba10-394580df708b service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:51.005629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076000f-a797-420c-ba10-394580df708b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:51.067473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076000f-a797-420c-ba10-394580df708b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:51.068938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076000f-a797-420c-ba10-394580df708b service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:51.081761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 918/1852] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:52.538643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:52.540428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:52.613992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076000f-a797-420c-ba10-394580df708b service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:52.623565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076000f-a797-420c-ba10-394580df708b service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:52.633654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc990f-51f3-4272-9371-8396311fad63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:52.634364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc990f-51f3-4272-9371-8396311fad63 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:52.634695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc990f-51f3-4272-9371-8396311fad63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:52.635184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc990f-51f3-4272-9371-8396311fad63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:52.645691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc990f-51f3-4272-9371-8396311fad63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:52.647958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc990f-51f3-4272-9371-8396311fad63 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:52.653910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcce43-dc9d-4661-8d6a-ef88b53c2cc1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:52.670682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:52.671799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:52.672285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:52.678427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 919/1853] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:52.678597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] PATH_INFO: `/v3/users/156428fbe8ef452d84ad861692dbf370` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:52.679943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=156428fbe8ef452d84ad861692dbf370)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:52.682103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:52.738361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156428fbe8ef452d84ad861692dbf370'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:52.739365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156428fbe8ef452d84ad861692dbf370'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:52.742050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156428fbe8ef452d84ad861692dbf370'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:52.755081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156428fbe8ef452d84ad861692dbf370'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:52.781836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156428fbe8ef452d84ad861692dbf370'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:52.798674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 935/1854] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:52 2022] DELETE /identity/v3/users/156428fbe8ef452d84ad861692dbf370 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:52.803744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:52.804281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:52.804560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:52.824465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:52.825708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:52.903198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 920/1855] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:52.914080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:52.916612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:52.969888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:52.988659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fe001-151a-4a3e-a6e2-b6c26fc57d4b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:52.992450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:52.993168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:52.993374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:52.993651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:53.002950 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:53.004703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:53.015608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 936/1856] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:53.356780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:53.359064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:53.373072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deaeb4-002c-4fff-bc84-50072c8bf3fa None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:53.379534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:53.380468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:53.380751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:53.381023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] PATH_INFO: `/v3/projects/39d5beeca9484debbfe9e21e96568cec` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:53.382367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d5beeca9484debbfe9e21e96568cec)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:53.384476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:53.453054 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d5beeca9484debbfe9e21e96568cec', 'request_id': 'req-a29f9603-ace6-4126-b706-8cf6ee07f7e7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.462088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d5beeca9484debbfe9e21e96568cec', 'request_id': 'req-a29f9603-ace6-4126-b706-8cf6ee07f7e7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.465212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:53.471940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d5beeca9484debbfe9e21e96568cec', 'request_id': 'req-a29f9603-ace6-4126-b706-8cf6ee07f7e7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.487873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] The token cache is being invalidate because project 39d5beeca9484debbfe9e21e96568cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:53.488184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.491835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.493520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 921/1857] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:53 2022] DELETE /identity/v3/projects/39d5beeca9484debbfe9e21e96568cec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:53.497944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:53.509158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f482f-bd86-4b6b-a2c0-549b95b0f042 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:53.577887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:53.578932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:53.579934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:53.580232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] PATH_INFO: `/v3/users/25a86e04f92d4868ad963de9c4689a11` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:53.582236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a86e04f92d4868ad963de9c4689a11)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:53.583662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:53.652563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a86e04f92d4868ad963de9c4689a11'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.653420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a86e04f92d4868ad963de9c4689a11'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.654159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a86e04f92d4868ad963de9c4689a11'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.664331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a86e04f92d4868ad963de9c4689a11'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.681306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9bd4657e-812d-4551-9aac-ed53ce5e8f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a86e04f92d4868ad963de9c4689a11'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:53.699644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 937/1858] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:53 2022] DELETE /identity/v3/users/25a86e04f92d4868ad963de9c4689a11 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:54.038023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.040025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:54.057950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f9603-ace6-4126-b706-8cf6ee07f7e7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.137024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.138711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.138997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.139309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] PATH_INFO: `/v3/projects/e4970e9ac0a142cc91fab50626113095` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.141070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4970e9ac0a142cc91fab50626113095)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.143534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.207929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4970e9ac0a142cc91fab50626113095', 'request_id': 'req-74b65219-7fb0-4ecb-99d5-cc65711f49ef'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.215807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4970e9ac0a142cc91fab50626113095', 'request_id': 'req-74b65219-7fb0-4ecb-99d5-cc65711f49ef'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.226409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4970e9ac0a142cc91fab50626113095', 'request_id': 'req-74b65219-7fb0-4ecb-99d5-cc65711f49ef'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.245048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] The token cache is being invalidate because project e4970e9ac0a142cc91fab50626113095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:54.245363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.246650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-74b65219-7fb0-4ecb-99d5-cc65711f49ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.249164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 922/1859] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:54 2022] DELETE /identity/v3/projects/e4970e9ac0a142cc91fab50626113095 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:54.256220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.256497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.256849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.307944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:54.309813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:54.420656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:54.443326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 938/1860] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:54.446429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.446733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.446991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.474727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:54.476231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:54.485456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 923/1861] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:54.489923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.501009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f817-d737-4b62-8866-4bccb07a00af None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.505990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.506850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.507123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.507420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.508157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:54.508602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.510263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.525624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 939/1862] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:17:54.529981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.542464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15604bfb-7e54-4d61-881c-e8b2f399e242 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.547879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.548634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.551516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.552128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.552886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.555822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.601009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 924/1863] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:54 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:54.604995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.616426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04267890-7272-4c8e-b5a0-c7a9234f56cb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.693383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.694155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.694534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.694880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.695700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.698618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.727804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 940/1864] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:54 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:54.732770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.747345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba6b02-a2af-42c5-810a-aa6028575492 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.754170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.754787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.755119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.755435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.756175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.757825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.772588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 925/1865] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:54.776617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.796760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d065db-361e-406a-91d8-6363075f0d89 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.804994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.805913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.806466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.806917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.807918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.809763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.818079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.821104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:54.826877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 941/1866] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:54.828198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:54.836991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a8704-ffb7-4aaf-866b-b44cda830d99 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.839772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871229-a726-4539-ba4c-9859f5ade75e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:54.842324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.843340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.843620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.843885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] PATH_INFO: `/v3/users/601f6087df304d3898aee099d8a98228` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.845082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601f6087df304d3898aee099d8a98228)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.845785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab945-6c5d-4c2e-ad78-c9995506702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:54.846881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab945-6c5d-4c2e-ad78-c9995506702b admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.847069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.847631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab945-6c5d-4c2e-ad78-c9995506702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.848338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab945-6c5d-4c2e-ad78-c9995506702b admin admin] PATH_INFO: `/v3/projects/97e92f6c32a74cfa87a5f726742cff1d/users/df3ea6b9de884b87a11855386e45dea2/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.866217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab945-6c5d-4c2e-ad78-c9995506702b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e92f6c32a74cfa87a5f726742cff1d, user_id=df3ea6b9de884b87a11855386e45dea2, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:54.869279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab945-6c5d-4c2e-ad78-c9995506702b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:54.885231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 942/1867] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:54 2022] PUT /identity/v3/projects/97e92f6c32a74cfa87a5f726742cff1d/users/df3ea6b9de884b87a11855386e45dea2/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:54.890768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:54.897460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.898288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.898742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.908645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601f6087df304d3898aee099d8a98228'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.917648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601f6087df304d3898aee099d8a98228'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.918991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601f6087df304d3898aee099d8a98228'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.920840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601f6087df304d3898aee099d8a98228'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.928933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] MFA Rules not processed for user `df3ea6b9de884b87a11855386e45dea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:54.930152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:54.937306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f404edcc-9f23-42bf-9d9c-1fdd814308c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601f6087df304d3898aee099d8a98228'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:54.956933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 926/1868] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:54 2022] DELETE /identity/v3/users/601f6087df304d3898aee099d8a98228 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:54.958554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:54.958925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:54.959449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:54.978297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:54.979653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:55.015842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 943/1869] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:17:55.020416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.021863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:55.051308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 927/1870] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:55.058101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.059699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:55.075285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:55.126979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278de27a-8f4a-4d46-8552-334c29f5bc98 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.133389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.134345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.135040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.135550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.136397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.139916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.144804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddf9e2-c15c-43d9-89cc-9fc88ac2a85d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.149024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.149692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.149974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.150247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.161921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.163452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.176579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 928/1871] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:55.188575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 944/1872] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:55 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:55.192883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.203690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aff9c9-7dd6-45fe-be55-2faeffc1fe42 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.260942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:55.275442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.276138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.276424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.276700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.277403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.279586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.313862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 929/1873] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:55 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:55.314770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.326068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b34d1d-5bde-45a8-9b5b-11a99cd79ff7 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.330737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.331533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.331819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.332094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.332822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.335811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.369612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 945/1874] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:55.370646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.392858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201f722-c84a-4de4-9a08-b8bdf1b81263 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.405756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.406676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.406956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.407258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] PATH_INFO: `/v3/projects/40429f9be0bb4dc2a00a99e9346b0b06/users/6bba0f0d330e4422b699c0753aa31aa0/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.435763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40429f9be0bb4dc2a00a99e9346b0b06, user_id=6bba0f0d330e4422b699c0753aa31aa0, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.439438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.466979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 930/1875] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:55 2022] PUT /identity/v3/projects/40429f9be0bb4dc2a00a99e9346b0b06/users/6bba0f0d330e4422b699c0753aa31aa0/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:55.471504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.485397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a19782-824a-48d2-9b0a-8b1ca7c33751 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.530413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.532711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:55.638787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.639511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.639797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.640073 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.640811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.642433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.664121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 946/1876] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:55.668197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.685964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0765798-5b32-4955-9d43-b017759b776b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.703037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b6ece-c029-470d-8ce5-ccb3b150fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.704307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b6ece-c029-470d-8ce5-ccb3b150fdfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.704844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b6ece-c029-470d-8ce5-ccb3b150fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.705244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b6ece-c029-470d-8ce5-ccb3b150fdfb admin admin] PATH_INFO: `/v3/projects/40429f9be0bb4dc2a00a99e9346b0b06/users/6bba0f0d330e4422b699c0753aa31aa0/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.708234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b6ece-c029-470d-8ce5-ccb3b150fdfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=40429f9be0bb4dc2a00a99e9346b0b06, user_id=6bba0f0d330e4422b699c0753aa31aa0, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.711623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b6ece-c029-470d-8ce5-ccb3b150fdfb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.712372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565838f4-d6a1-406a-a376-4ea5f89275c3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:55.728358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:55.732285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.742775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 947/1877] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:55 2022] PUT /identity/v3/projects/40429f9be0bb4dc2a00a99e9346b0b06/users/6bba0f0d330e4422b699c0753aa31aa0/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:55.744610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.744905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.745038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.745362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] PATH_INFO: `/v3/projects/b9fe1710c4aa406fb9632109d9ed6a3e` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.746068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.747911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fe1710c4aa406fb9632109d9ed6a3e)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:55.754915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:55.807722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] MFA Rules not processed for user `6bba0f0d330e4422b699c0753aa31aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:55.809446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:55.845914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fe1710c4aa406fb9632109d9ed6a3e', 'request_id': 'req-8edad345-b6ec-4bf1-88f2-165d4380b338'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:55.855518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fe1710c4aa406fb9632109d9ed6a3e', 'request_id': 'req-8edad345-b6ec-4bf1-88f2-165d4380b338'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:55.867712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fe1710c4aa406fb9632109d9ed6a3e', 'request_id': 'req-8edad345-b6ec-4bf1-88f2-165d4380b338'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:55.896482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] The token cache is being invalidate because project b9fe1710c4aa406fb9632109d9ed6a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:17:55.896482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:55.897015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8edad345-b6ec-4bf1-88f2-165d4380b338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:55.901839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 931/1878] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:17:55 2022] DELETE /identity/v3/projects/b9fe1710c4aa406fb9632109d9ed6a3e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:55.904006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6949a9-cc29-499d-a2d3-bccbe3707f34 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:55.904294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6949a9-cc29-499d-a2d3-bccbe3707f34 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:55.904719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6949a9-cc29-499d-a2d3-bccbe3707f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:55.964820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7a6949a9-cc29-499d-a2d3-bccbe3707f34 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:55.966391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7a6949a9-cc29-499d-a2d3-bccbe3707f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:55.970429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 948/1879] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:55.983736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:55.985365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:56.036712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:56.077398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:56.113908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 932/1880] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:56.126993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.127405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.127782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.151571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589b3dd-409c-4795-8a23-acfba5952e6c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.152333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:56.153212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:56.162730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 933/1881] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:56.167635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.192063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46b58-38ba-4e9c-8d21-f306ce69cb98 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.210764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.211565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.211912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.212450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.213253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:17:56.213622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.215425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.242808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 934/1882] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:17:56.248992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.263934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28de61-92db-4dd7-aad7-6651e6e3ffb2 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.264860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.265870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.266330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.266805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.270845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.271732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.272183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.273204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.275184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.278593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.327305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 935/1883] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:17:56 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:17:56.332726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.392234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.392740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.408992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 949/1884] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:17:56.452775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071e24-60e9-4c1e-bf56-7603649c3eb3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.460473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.461792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.462284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.463052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.463987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.466163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.475497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.487537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7785a97-5a18-49b6-9be9-2e2c07d8cbbe service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.510647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 936/1885] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:17:56 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:17:56.512339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.533709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307652b-4a28-40b4-8f0a-49623bb67d6f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.557751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.558534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.558879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.559242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.561009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.563566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.581576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 937/1886] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:56.586681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.611418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f69137-e33a-4184-9ff4-91ed45eef280 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.630567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.630567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.630567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.631038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.631038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.631038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.631038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.631368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.631368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.634106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.636204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:56.649404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 938/1887] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:17:56.653540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.668388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1c233-c81f-4149-aad1-9b0a205bede6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:56.675926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffcb97-ec65-4be3-bd0a-76d2801d635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:56.677065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffcb97-ec65-4be3-bd0a-76d2801d635d admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.677515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffcb97-ec65-4be3-bd0a-76d2801d635d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.677934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffcb97-ec65-4be3-bd0a-76d2801d635d admin admin] PATH_INFO: `/v3/projects/53fa22c45e6041d3aceaa62949eb347b/users/b5978aa87de7495c9795beb8aa3c7389/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.701507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffcb97-ec65-4be3-bd0a-76d2801d635d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fa22c45e6041d3aceaa62949eb347b, user_id=b5978aa87de7495c9795beb8aa3c7389, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.703265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:56.705891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffcb97-ec65-4be3-bd0a-76d2801d635d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.730283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 939/1888] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:17:56 2022] PUT /identity/v3/projects/53fa22c45e6041d3aceaa62949eb347b/users/b5978aa87de7495c9795beb8aa3c7389/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:17:56.740997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:56.741288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:56.741564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:56.749747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:56.751419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:56.765499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 950/1889] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:56.807326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] MFA Rules not processed for user `b5978aa87de7495c9795beb8aa3c7389`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:56.808627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:56.860918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:56.924900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 940/1890] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:56.958529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:56.961626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:56.975373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd242ff-adf5-490c-a495-4daeba783857 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:57.039911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60f96-4ae7-4b17-a33d-5a3374565675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:57.040575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60f96-4ae7-4b17-a33d-5a3374565675 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:57.040858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60f96-4ae7-4b17-a33d-5a3374565675 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:57.041139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60f96-4ae7-4b17-a33d-5a3374565675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:57.051633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a60f96-4ae7-4b17-a33d-5a3374565675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:57.054263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a60f96-4ae7-4b17-a33d-5a3374565675 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:57.080311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 951/1891] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:17:59.518400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:59.519903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:59.592782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea7f19-4d07-4dd0-b76d-9b23fb8d19ba None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:59.597725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:59.598659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:59.598956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:59.599233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] PATH_INFO: `/v3/users/df3ea6b9de884b87a11855386e45dea2` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:59.600486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3ea6b9de884b87a11855386e45dea2)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:59.602404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:59.659485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3ea6b9de884b87a11855386e45dea2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:59.669249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3ea6b9de884b87a11855386e45dea2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:59.669996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3ea6b9de884b87a11855386e45dea2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:59.670659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3ea6b9de884b87a11855386e45dea2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:59.683577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3ea6b9de884b87a11855386e45dea2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:17:59.698068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 941/1892] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:17:59 2022] DELETE /identity/v3/users/df3ea6b9de884b87a11855386e45dea2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:17:59.702641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:59.703103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:59.703334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:59.721477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:17:59.722938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:59.782350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 952/1893] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:17:59.792665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:17:59.795100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:17:59.876225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a8b0d-a001-404a-88de-a860d4ebd545 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:17:59.881518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:17:59.882431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:17:59.882861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:17:59.883516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:17:59.899109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:17:59.900728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:17:59.908021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:17:59.918970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 942/1894] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:18:00.212098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:00.213637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:00.228310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9993d7-d4b6-4b7a-b51e-e0acd16e75c5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:00.234967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:00.235890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:00.236171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:00.236448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] PATH_INFO: `/v3/projects/97e92f6c32a74cfa87a5f726742cff1d` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:00.237726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e92f6c32a74cfa87a5f726742cff1d)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:00.239710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:00.296675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e92f6c32a74cfa87a5f726742cff1d', 'request_id': 'req-31e0a0b3-e320-4dfd-9531-dfd7650db189'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.302836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e92f6c32a74cfa87a5f726742cff1d', 'request_id': 'req-31e0a0b3-e320-4dfd-9531-dfd7650db189'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.308852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e92f6c32a74cfa87a5f726742cff1d', 'request_id': 'req-31e0a0b3-e320-4dfd-9531-dfd7650db189'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.319631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:00.323545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] The token cache is being invalidate because project 97e92f6c32a74cfa87a5f726742cff1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:00.323848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.324816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.326418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 953/1895] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:00 2022] DELETE /identity/v3/projects/97e92f6c32a74cfa87a5f726742cff1d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:00.330528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:00.340129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243291f1-9841-4efe-82eb-aecbca5aca66 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:00.400546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:00.401421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:00.401741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:00.401993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] PATH_INFO: `/v3/users/6bba0f0d330e4422b699c0753aa31aa0` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:00.403258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bba0f0d330e4422b699c0753aa31aa0)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:00.405209 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:00.458008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bba0f0d330e4422b699c0753aa31aa0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.466390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bba0f0d330e4422b699c0753aa31aa0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.467041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bba0f0d330e4422b699c0753aa31aa0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.467688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bba0f0d330e4422b699c0753aa31aa0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.479715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-880948ca-9cc6-40ca-9eca-1ed67040316a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bba0f0d330e4422b699c0753aa31aa0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.492063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 943/1896] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:00 2022] DELETE /identity/v3/users/6bba0f0d330e4422b699c0753aa31aa0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:00.773196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:00.775349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:00.794584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0a0b3-e320-4dfd-9531-dfd7650db189 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:00.859020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:00.860031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:00.860374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:00.860726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] PATH_INFO: `/v3/projects/40429f9be0bb4dc2a00a99e9346b0b06` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:00.862307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40429f9be0bb4dc2a00a99e9346b0b06)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:00.865124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:00.934107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40429f9be0bb4dc2a00a99e9346b0b06', 'request_id': 'req-ef0483e8-2640-4622-a86c-a4a6520fb509'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.942614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40429f9be0bb4dc2a00a99e9346b0b06', 'request_id': 'req-ef0483e8-2640-4622-a86c-a4a6520fb509'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.948990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40429f9be0bb4dc2a00a99e9346b0b06', 'request_id': 'req-ef0483e8-2640-4622-a86c-a4a6520fb509'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.964728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] The token cache is being invalidate because project 40429f9be0bb4dc2a00a99e9346b0b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:00.965098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.966854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ef0483e8-2640-4622-a86c-a4a6520fb509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:00.969121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 954/1897] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:00 2022] DELETE /identity/v3/projects/40429f9be0bb4dc2a00a99e9346b0b06 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:00.974413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:00.974964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:00.974964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:00.994188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:00.994787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:01.082373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 944/1898] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:01.083400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.083695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.083977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.113767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:01.115019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:01.123558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 955/1899] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:01.129558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.141179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d92280-121e-491c-9f1c-3075670c2693 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.146512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.147107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.147435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.147836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.148572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:01.148870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.150478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.163881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 945/1900] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:01.170226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.179784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d290-da3f-46af-8d58-c7c1ef46bc2f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.184574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.185228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.185618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.185772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.186480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.188488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.224530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 956/1901] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:01 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:01.228410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.240912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061be39-8701-4af1-8652-e4cf0b838167 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.245453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:01.317912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.318607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.319223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.319397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.320522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.322530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.349319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 946/1902] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:01 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:01.352934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.364958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ace11a-e9f2-466f-a1a1-c398ea3c6db5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.370481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.371395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.371778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.372205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.379601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.381395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.393003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 957/1903] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:01.397527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.407998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684070-9e8e-4619-9b44-9bbeca4cb142 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.412710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b657c-4ef1-477b-a14e-70887865b0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.413377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b657c-4ef1-477b-a14e-70887865b0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.413678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b657c-4ef1-477b-a14e-70887865b0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.413954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b657c-4ef1-477b-a14e-70887865b0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.414677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b657c-4ef1-477b-a14e-70887865b0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.416667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b657c-4ef1-477b-a14e-70887865b0a9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.427195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 947/1904] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:01.431042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.441316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844befab-8c19-4a92-b4d7-0cb63868d51a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.446355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.447374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.447654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.447920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] PATH_INFO: `/v3/projects/4a14f94725fc4f3abfaad8c2c0ce56ad/users/754201f371ff426d97fa2e816aa7d31b/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.463514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a14f94725fc4f3abfaad8c2c0ce56ad, user_id=754201f371ff426d97fa2e816aa7d31b, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.466164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.480757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 958/1905] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:01 2022] PUT /identity/v3/projects/4a14f94725fc4f3abfaad8c2c0ce56ad/users/754201f371ff426d97fa2e816aa7d31b/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:01.491965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.492256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.492538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.520763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] MFA Rules not processed for user `754201f371ff426d97fa2e816aa7d31b`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:01.521976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:01.590842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 948/1906] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:01.595751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.628251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:01.669846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb911-4a48-499a-843a-0966868482b2 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.674665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.675361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.675648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.675921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.676617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.678538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.707504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 959/1907] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:01 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:01.712042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.724079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e6e29-d784-4059-adc7-34df53e98f4a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.785357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.786035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.786318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.786601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.787353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.789379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.809623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 949/1908] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:01 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:01.814477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.825991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c79298-2055-4192-a5d6-70dca0b1e219 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.832612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.833334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.833938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.834222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.834953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.836739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.849005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 960/1909] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:01.853377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.860697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:01.865121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5b124-3071-4243-9706-def809b8c3f5 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:01.872736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:01.874468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:01.874753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:01.875027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] PATH_INFO: `/v3/projects/bc0379d215db478b960c6a2808918b89/users/e4fa82bbca7a4b3d86095c0f91f51aaa/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:01.890642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0379d215db478b960c6a2808918b89, user_id=e4fa82bbca7a4b3d86095c0f91f51aaa, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:01.893381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:01.908423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 950/1910] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:01 2022] PUT /identity/v3/projects/bc0379d215db478b960c6a2808918b89/users/e4fa82bbca7a4b3d86095c0f91f51aaa/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:01.912465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:01.922974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac0604-a12d-4b96-92f8-0ceddbcb2174 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:02.018325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900b90c-e703-4e92-bbbf-f1f746461b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:02.019081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b90c-e703-4e92-bbbf-f1f746461b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:02.019398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b90c-e703-4e92-bbbf-f1f746461b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:02.019681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900b90c-e703-4e92-bbbf-f1f746461b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:02.020430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900b90c-e703-4e92-bbbf-f1f746461b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:02.022070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900b90c-e703-4e92-bbbf-f1f746461b54 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:02.051573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 961/1911] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:02.052917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:02.095035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b642-fe0d-49bd-83b7-235fc2c7ea68 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:02.100781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:02.101758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:02.102141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:02.103277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] PATH_INFO: `/v3/projects/bc0379d215db478b960c6a2808918b89/users/e4fa82bbca7a4b3d86095c0f91f51aaa/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:02.106528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0379d215db478b960c6a2808918b89, user_id=e4fa82bbca7a4b3d86095c0f91f51aaa, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:02.112336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:02.129657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 951/1912] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:02 2022] PUT /identity/v3/projects/bc0379d215db478b960c6a2808918b89/users/e4fa82bbca7a4b3d86095c0f91f51aaa/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:02.139825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:02.140703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:02.141306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:02.241512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] MFA Rules not processed for user `e4fa82bbca7a4b3d86095c0f91f51aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:02.242857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:02.374179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 962/1913] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:02.389631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:02.391570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:02.495889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33db5bd-1bec-4493-ac56-f14f60e5f680 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:02.501439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:02.502331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:02.502780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:02.503567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:02.516756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:02.518906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:02.549350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 952/1914] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:02.748085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:02.749737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:02.767816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7becdd-7038-4507-af1e-649c9b77fe9e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:02.771895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12b726-0701-46a2-b6a1-ce457023e7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:02.772561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12b726-0701-46a2-b6a1-ce457023e7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:02.772916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12b726-0701-46a2-b6a1-ce457023e7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:02.773267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12b726-0701-46a2-b6a1-ce457023e7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:02.793430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:02.834576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12b726-0701-46a2-b6a1-ce457023e7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:02.836063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12b726-0701-46a2-b6a1-ce457023e7b3 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:02.847242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 963/1915] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:07.647546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:07.760662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3107ad-3bc9-424c-abd7-108174dc637d service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:07.772148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:07.773791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:07.774296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:07.774877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] PATH_INFO: `/v3/users/754201f371ff426d97fa2e816aa7d31b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:07.776622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=754201f371ff426d97fa2e816aa7d31b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:07.779190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:07.850081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754201f371ff426d97fa2e816aa7d31b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:07.864017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754201f371ff426d97fa2e816aa7d31b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:07.866130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754201f371ff426d97fa2e816aa7d31b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:07.867287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754201f371ff426d97fa2e816aa7d31b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:07.891772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754201f371ff426d97fa2e816aa7d31b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:07.893892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:07.926073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 953/1916] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:07 2022] DELETE /identity/v3/users/754201f371ff426d97fa2e816aa7d31b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:07.930768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:07.931253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:07.931253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:07.960214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:07.961410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:08.072966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 964/1917] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:08.085119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:08.086633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:08.216063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5640ce-a4b0-43a4-8714-d26d1698e55a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:08.219975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:08.220715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:08.221071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:08.221352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:08.238907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:08.238907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:08.247535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 954/1918] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:08.616964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:08.619509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:08.640996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e068535-de3a-404b-9f4b-60f1787ed7b1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:08.663523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:08.666053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:08.667709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:08.668250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] PATH_INFO: `/v3/projects/4a14f94725fc4f3abfaad8c2c0ce56ad` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:08.672738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a14f94725fc4f3abfaad8c2c0ce56ad)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:08.675374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:08.763352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a14f94725fc4f3abfaad8c2c0ce56ad', 'request_id': 'req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.770248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a14f94725fc4f3abfaad8c2c0ce56ad', 'request_id': 'req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.775728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a14f94725fc4f3abfaad8c2c0ce56ad', 'request_id': 'req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.794922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] The token cache is being invalidate because project 4a14f94725fc4f3abfaad8c2c0ce56ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:08.795136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.795862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.797934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 965/1919] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:08 2022] DELETE /identity/v3/projects/4a14f94725fc4f3abfaad8c2c0ce56ad => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:08.802616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:08.818168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f893-fb2b-4a8c-9ea3-fa25301f8261 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:08.890356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:08.890356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:08.890356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:08.890356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] PATH_INFO: `/v3/users/e4fa82bbca7a4b3d86095c0f91f51aaa` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:08.891011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4fa82bbca7a4b3d86095c0f91f51aaa)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:08.895950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:08.973563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4fa82bbca7a4b3d86095c0f91f51aaa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.984037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4fa82bbca7a4b3d86095c0f91f51aaa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.986062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4fa82bbca7a4b3d86095c0f91f51aaa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:08.987126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4fa82bbca7a4b3d86095c0f91f51aaa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.008812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-262e1197-effb-4e1e-b14c-4bc10480750b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4fa82bbca7a4b3d86095c0f91f51aaa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.025999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 955/1920] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:08 2022] DELETE /identity/v3/users/e4fa82bbca7a4b3d86095c0f91f51aaa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:09.511631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:09.514025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:09.540546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379a1b5-61f6-4533-9f6d-f851fe5c32ad admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:09.608064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:09.634785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:09.635909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:09.636439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:09.636877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] PATH_INFO: `/v3/projects/bc0379d215db478b960c6a2808918b89` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:09.638399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0379d215db478b960c6a2808918b89)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:09.641037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:09.703269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0379d215db478b960c6a2808918b89', 'request_id': 'req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.709678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0379d215db478b960c6a2808918b89', 'request_id': 'req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.716491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0379d215db478b960c6a2808918b89', 'request_id': 'req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.731177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] The token cache is being invalidate because project bc0379d215db478b960c6a2808918b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:09.731504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.732131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb9e26b7-2719-41f4-bcc3-7b1a73012a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:09.733696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 966/1921] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:09 2022] DELETE /identity/v3/projects/bc0379d215db478b960c6a2808918b89 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:09.738738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:09.739097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:09.739412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:09.759193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:09.760557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:09.766857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:09.835832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 956/1922] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:09.844017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:09.844436 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:09.844775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:09.864544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:09.865749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:09.874460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 967/1923] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:09.878902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:09.889466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00491f90-1648-4ae9-ae84-f564b109ae6a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:09.898344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:09.899025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:09.899593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:09.899593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:09.900330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:09.900638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:09.902247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:09.915190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 957/1924] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:09.919844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:09.934240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b386943-a824-40fa-a978-ba4b652c39aa None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:09.939545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:09.940422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:09.940736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:09.941011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:09.942139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:09.944296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:09.982072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 968/1925] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:09 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:09.985960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:09.997413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29395b00-d2c0-4c0b-aa88-278077fb1c5e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.071418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.072199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.072576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.072927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.073822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.076331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.102725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 958/1926] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:09 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:10.104322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.135578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bb7ad-98c6-4f48-9f61-237e984ec687 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.142452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.143840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.145625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.146377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.150099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.153425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.178035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 969/1927] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:10.182510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.192798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033f301-f19c-4b73-9080-0d107dd8b4b8 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.197537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf0e7b-a190-48c3-9422-51109dfb0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.198201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0e7b-a190-48c3-9422-51109dfb0d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.198483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0e7b-a190-48c3-9422-51109dfb0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.198758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf0e7b-a190-48c3-9422-51109dfb0d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.199590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf0e7b-a190-48c3-9422-51109dfb0d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.201199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf0e7b-a190-48c3-9422-51109dfb0d00 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.212229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 959/1928] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:10.216268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.228379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7fcd1-0c7f-4e64-844d-b0127bd3da0c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.233051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.234035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.234388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.234734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] PATH_INFO: `/v3/projects/5c23d941ecde4fc39a3c1eacf3f24970/users/efadaae64ba74d28874ec6e68a3b6f1f/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.253100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c23d941ecde4fc39a3c1eacf3f24970, user_id=efadaae64ba74d28874ec6e68a3b6f1f, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.256414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.278710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 970/1929] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:10 2022] PUT /identity/v3/projects/5c23d941ecde4fc39a3c1eacf3f24970/users/efadaae64ba74d28874ec6e68a3b6f1f/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:10.290077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.290477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.290825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.329733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] MFA Rules not processed for user `efadaae64ba74d28874ec6e68a3b6f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:10.331168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:10.433765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 960/1930] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:10.435948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.513111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654f77a-8829-45ce-a597-1ff3ff7d5ebb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.519734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.520698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.521186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.521477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.522504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.525660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.543202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:10.559029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 971/1931] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:10.563000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.574412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c00b7b-31a1-4fd3-8b06-64452b0a670a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.582951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:10.649414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.650210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.650488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.650762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.651645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.653746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.678326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 961/1932] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:10 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:10.682224 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.692904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561132a-b172-46dc-bea9-d395be7ada14 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.701690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.702376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.702657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.702937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.703713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.705382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.717253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 972/1933] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:10.721233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.732726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff3825-dfe4-46f5-b2cc-fd7930fda039 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.738020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e6329-f0c3-4fdb-b98e-e5c7c3ecd9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.738786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6329-f0c3-4fdb-b98e-e5c7c3ecd9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.739140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6329-f0c3-4fdb-b98e-e5c7c3ecd9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.739531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e6329-f0c3-4fdb-b98e-e5c7c3ecd9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.740354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e6329-f0c3-4fdb-b98e-e5c7c3ecd9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.742098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e6329-f0c3-4fdb-b98e-e5c7c3ecd9e0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.755048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 962/1934] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:10.759094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.769346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e1d3-052d-4d9d-ae64-4a7f5ece3bc5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.774370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.775397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.775681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.775960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] PATH_INFO: `/v3/projects/f94b5749bc8f4fde954ac35516d12498/users/0b0f3f6400474277b1a08bae93bbd3f1/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.790734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94b5749bc8f4fde954ac35516d12498, user_id=0b0f3f6400474277b1a08bae93bbd3f1, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.793756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:10.806498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 973/1935] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:10 2022] PUT /identity/v3/projects/f94b5749bc8f4fde954ac35516d12498/users/0b0f3f6400474277b1a08bae93bbd3f1/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:10.816837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fccaf-23e9-40da-b578-9f0a847a59e6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.817247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fccaf-23e9-40da-b578-9f0a847a59e6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.817533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7fccaf-23e9-40da-b578-9f0a847a59e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.844354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-cc7fccaf-23e9-40da-b578-9f0a847a59e6 None None] MFA Rules not processed for user `0b0f3f6400474277b1a08bae93bbd3f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:10.845571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cc7fccaf-23e9-40da-b578-9f0a847a59e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:10.912339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 963/1936] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:10.917462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:10.967974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b24b-bdb8-426c-a073-d75f2b30bc1f None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.968248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b24b-bdb8-426c-a073-d75f2b30bc1f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.968546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b24b-bdb8-426c-a073-d75f2b30bc1f None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.969962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 964/1937] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:18:10.981099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.981425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126134c-81dc-4c83-aa5d-51c0dc1ecd82 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:10.981610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.982091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.986450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:10.987063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:10.987682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:10.987960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:10.988768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:10.990676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.002517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:11.004020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.019793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 974/1938] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:10 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:11.031645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.101640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 965/1939] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:18:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:11.115655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.115850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1e5e1-8e39-4950-8a91-376faa7f4281 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.117027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.120687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.121495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.121682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.121932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.123629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.125778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.131693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3c770-f1f0-4ed2-b5d7-1e636c19c5ff None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.142436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:11.157196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 975/1940] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:11 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:11.161244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.176150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827e7bb-2071-4a50-8597-0a5bf8e0f205 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.182510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.183374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.183695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.184275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.185173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.187461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.205681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 976/1941] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:18:11.209887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.221438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.222226 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.222508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.222928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.235691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07506-a16b-4f1c-9b81-a72b95377b12 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.236988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.239471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.257837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 966/1942] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:11.272023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.272948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.273232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.273520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] PATH_INFO: `/v3/projects/57b6e67dd6b14b5fb2f0ec4e0d17e020/users/adf2793bd7cb4b009c7fb5ea1848b626/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.311083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b6e67dd6b14b5fb2f0ec4e0d17e020, user_id=adf2793bd7cb4b009c7fb5ea1848b626, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.313838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.324455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:11.337707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.338906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 977/1943] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:11 2022] PUT /identity/v3/projects/57b6e67dd6b14b5fb2f0ec4e0d17e020/users/adf2793bd7cb4b009c7fb5ea1848b626/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:11.351409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302583eb-5a86-4105-a74b-52ec4f84e277 service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.427796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bcb09-4a5b-4ffc-ac56-288c1337c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.429454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bcb09-4a5b-4ffc-ac56-288c1337c0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.429951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bcb09-4a5b-4ffc-ac56-288c1337c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.430523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bcb09-4a5b-4ffc-ac56-288c1337c0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.431540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bcb09-4a5b-4ffc-ac56-288c1337c0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.434556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bcb09-4a5b-4ffc-ac56-288c1337c0e8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.447588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 967/1944] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:11.451497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.462781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0490d-36bf-49db-8903-6641ac496316 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.475689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.476605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.476893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.477169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] PATH_INFO: `/v3/projects/57b6e67dd6b14b5fb2f0ec4e0d17e020/users/adf2793bd7cb4b009c7fb5ea1848b626/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.479336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b6e67dd6b14b5fb2f0ec4e0d17e020, user_id=adf2793bd7cb4b009c7fb5ea1848b626, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.482268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.495449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 978/1945] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:11 2022] PUT /identity/v3/projects/57b6e67dd6b14b5fb2f0ec4e0d17e020/users/adf2793bd7cb4b009c7fb5ea1848b626/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:11.506677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14cbd-57e4-45c5-9213-e14a2693ca0d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.506961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14cbd-57e4-45c5-9213-e14a2693ca0d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.507330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14cbd-57e4-45c5-9213-e14a2693ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.534565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c5b14cbd-57e4-45c5-9213-e14a2693ca0d None None] MFA Rules not processed for user `adf2793bd7cb4b009c7fb5ea1848b626`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:11.535795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c5b14cbd-57e4-45c5-9213-e14a2693ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.613127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 968/1946] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:11.627241 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.629058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.673552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3a664-81e9-4270-9833-f81a4ecf44f1 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.673841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3a664-81e9-4270-9833-f81a4ecf44f1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.674821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3a664-81e9-4270-9833-f81a4ecf44f1 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.676473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 969/1947] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 16:18:11.689782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f041-d7e8-4bb0-b58b-7a4f101ceeec admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.693698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.694349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.694627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.694896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.703948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.704228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.704499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.704616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.706535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.717690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 979/1948] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:11.733687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] MFA Rules not processed for user `59e10be40282478faf3da72169dee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:11.735785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.743461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.744984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.764040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:11.814223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556d746-0fc9-4fa5-82c2-dec9017caeb8 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.818771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.819683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.819962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.820236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] PATH_INFO: `/v3/users/2c8319d920344eeea83bb8f072ff2f42` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.821215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 970/1949] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:11.821451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c8319d920344eeea83bb8f072ff2f42)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.821832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.823130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.823407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.835107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356e89b-b5ed-47fb-8088-57f64331fbef None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.838843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:11.839518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:11.839798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:11.840066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:11.871288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c8319d920344eeea83bb8f072ff2f42'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:11.871992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c8319d920344eeea83bb8f072ff2f42'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:11.872606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c8319d920344eeea83bb8f072ff2f42'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:11.880252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c8319d920344eeea83bb8f072ff2f42'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:11.893219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c8319d920344eeea83bb8f072ff2f42'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:11.899881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:11.901373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:11.905594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 980/1950] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:11 2022] DELETE /identity/v3/users/2c8319d920344eeea83bb8f072ff2f42 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:11.906390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:11.907732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:11.914652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 971/1951] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:11.918887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:11.993695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891b867-4dcc-495f-8671-def165d0b9b8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:11.999554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:12.000212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:12.000650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:12.000934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:12.002771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:12.015468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:12.016920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:12.028144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 981/1952] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:12.097407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:12.110170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a9b04-9728-44bf-810f-5d3db8ba57ff service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:12.182061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:12.182939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:12.183275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:12.183548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] PATH_INFO: `/v3/projects/65159cf73c344ca09e12119ed1b2e6a7` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:12.184704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65159cf73c344ca09e12119ed1b2e6a7)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:12.186725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:12.239047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65159cf73c344ca09e12119ed1b2e6a7', 'request_id': 'req-384cc2f6-5d59-44ca-9895-c4584c978929'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.249542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65159cf73c344ca09e12119ed1b2e6a7', 'request_id': 'req-384cc2f6-5d59-44ca-9895-c4584c978929'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.254330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:12.256991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65159cf73c344ca09e12119ed1b2e6a7', 'request_id': 'req-384cc2f6-5d59-44ca-9895-c4584c978929'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.284248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] The token cache is being invalidate because project 65159cf73c344ca09e12119ed1b2e6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:12.284248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.284248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.284248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 972/1953] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:12 2022] DELETE /identity/v3/projects/65159cf73c344ca09e12119ed1b2e6a7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:12.286694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:12.288386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:12.301991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30f6a2-21cd-457d-9046-4693a37761f1 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:12.359477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:12.360361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:12.360637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:12.360904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] PATH_INFO: `/v3/users/4b40ab67110147d0aca75380b808b7a1` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:12.362097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b40ab67110147d0aca75380b808b7a1)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:12.364084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:12.414140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b40ab67110147d0aca75380b808b7a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.414781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b40ab67110147d0aca75380b808b7a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.415470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b40ab67110147d0aca75380b808b7a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.425137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b40ab67110147d0aca75380b808b7a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.438005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e9f1405b-fceb-4c38-950c-6b1c740c0b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b40ab67110147d0aca75380b808b7a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.450433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 982/1954] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:12 2022] DELETE /identity/v3/users/4b40ab67110147d0aca75380b808b7a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:12.799264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:12.800909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:12.821950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc2f6-5d59-44ca-9895-c4584c978929 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:12.887921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:12.889037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:12.889483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:12.889921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] PATH_INFO: `/v3/projects/03bd081c73f446218d45d02dd7230aaf` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:12.891273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bd081c73f446218d45d02dd7230aaf)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:12.893714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:12.970860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bd081c73f446218d45d02dd7230aaf', 'request_id': 'req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.978892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bd081c73f446218d45d02dd7230aaf', 'request_id': 'req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:12.986696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bd081c73f446218d45d02dd7230aaf', 'request_id': 'req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:13.004143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] The token cache is being invalidate because project 03bd081c73f446218d45d02dd7230aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:13.004433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:13.005134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-24bdc1b0-cbd8-4df3-8bf1-b2cc57655083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:13.015737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 973/1955] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:12 2022] DELETE /identity/v3/projects/03bd081c73f446218d45d02dd7230aaf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:13.020604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.021537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.021813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.042543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:13.043801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:13.059173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:13.116733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 983/1956] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:13.124429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.124727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.125026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.143978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:13.145185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:13.153725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 974/1957] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:13.158143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.171548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda526f-6a23-4f0a-a70e-abe66140807f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.173010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.173677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.173954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.174220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.174993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:13.175326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.176926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.188942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 984/1958] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:13.193446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.203413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165fbd3-4000-466c-be5d-908823e16f2e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.208127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.208795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.209204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.209345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.210020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.211972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.238424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 975/1959] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:13 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:13.242406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.252590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1c165-e3f3-4868-8b43-dced587a291f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.314384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.315104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.315767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.316081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.316958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.318913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.364498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 985/1960] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:13 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:13.366160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.382138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3609bf1-aeda-4c33-a5af-a89f12ea15cb admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.388087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.388781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.389205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.389557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.390322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.392018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.404217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 976/1961] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:13.408485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.421672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c504ea-97ae-4725-af68-22b3f4ab830b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.452068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca0e49-c212-4584-b567-bd1723cbdd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.453061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca0e49-c212-4584-b567-bd1723cbdd3d admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.453448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca0e49-c212-4584-b567-bd1723cbdd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.453787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca0e49-c212-4584-b567-bd1723cbdd3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.454576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca0e49-c212-4584-b567-bd1723cbdd3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.456474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca0e49-c212-4584-b567-bd1723cbdd3d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.474648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 986/1962] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:13.476123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.500354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3b20-5ff8-4145-b3bc-c395018f0296 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.512827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.513985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.514555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.514933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] PATH_INFO: `/v3/projects/ce04cad540d04d3e8830f3062bb0f62b/users/1e92ec02dd634c63a50affd80a7418ae/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.547115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce04cad540d04d3e8830f3062bb0f62b, user_id=1e92ec02dd634c63a50affd80a7418ae, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.550847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.579147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 977/1963] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:13 2022] PUT /identity/v3/projects/ce04cad540d04d3e8830f3062bb0f62b/users/1e92ec02dd634c63a50affd80a7418ae/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:13.590380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.590672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.590952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.620199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] MFA Rules not processed for user `1e92ec02dd634c63a50affd80a7418ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:13.621455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:13.704825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 987/1964] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:13.716461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.718351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:13.738354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:13.794009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff587fd-0afe-4ea1-add8-1e6f804fa654 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.797973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c937c-52ce-4f77-aa95-a44f97e44a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.798633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c937c-52ce-4f77-aa95-a44f97e44a06 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.798912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c937c-52ce-4f77-aa95-a44f97e44a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.799234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c937c-52ce-4f77-aa95-a44f97e44a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.808265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c937c-52ce-4f77-aa95-a44f97e44a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.809731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c937c-52ce-4f77-aa95-a44f97e44a06 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.819404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 978/1965] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:13.842846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:13.861153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:13.933360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0553f-e0bd-46ad-9b12-cce48b26829e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:13.938615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:13.939628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:13.939908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:13.940208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] PATH_INFO: `/v3/users/1e92ec02dd634c63a50affd80a7418ae` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:13.941415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e92ec02dd634c63a50affd80a7418ae)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:13.943376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:13.994612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e92ec02dd634c63a50affd80a7418ae'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:13.995380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e92ec02dd634c63a50affd80a7418ae'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:13.995936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e92ec02dd634c63a50affd80a7418ae'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.011280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e92ec02dd634c63a50affd80a7418ae'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.026157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e92ec02dd634c63a50affd80a7418ae'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.039427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 988/1966] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:13 2022] DELETE /identity/v3/users/1e92ec02dd634c63a50affd80a7418ae => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:14.044341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.044822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.044898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.062137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:14.063587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:14.141469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 979/1967] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:14.152393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:14.153954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:14.227092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f695db1-ca03-4ee9-8301-96417d71b688 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:14.233280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f30bc-b49e-4d35-bf3d-5a678526938a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:14.233945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f30bc-b49e-4d35-bf3d-5a678526938a service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.234227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f30bc-b49e-4d35-bf3d-5a678526938a service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.234499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f30bc-b49e-4d35-bf3d-5a678526938a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.245065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f30bc-b49e-4d35-bf3d-5a678526938a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:14.246490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f30bc-b49e-4d35-bf3d-5a678526938a service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:14.258903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 989/1968] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:14.567226 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:14.569015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:14.581758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9d48e-e266-478b-828e-ce1bef968283 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:14.587424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:14.588295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.588575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.588857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] PATH_INFO: `/v3/projects/ce04cad540d04d3e8830f3062bb0f62b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.590045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce04cad540d04d3e8830f3062bb0f62b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:14.592070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:14.645119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce04cad540d04d3e8830f3062bb0f62b', 'request_id': 'req-761b8f74-a4ee-4144-8f6b-3f709558d304'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.653352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce04cad540d04d3e8830f3062bb0f62b', 'request_id': 'req-761b8f74-a4ee-4144-8f6b-3f709558d304'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.659091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce04cad540d04d3e8830f3062bb0f62b', 'request_id': 'req-761b8f74-a4ee-4144-8f6b-3f709558d304'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.673601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] The token cache is being invalidate because project ce04cad540d04d3e8830f3062bb0f62b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:14.673891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.674561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761b8f74-a4ee-4144-8f6b-3f709558d304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:14.676294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 980/1969] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:14 2022] DELETE /identity/v3/projects/ce04cad540d04d3e8830f3062bb0f62b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:14.682265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.682637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.682993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.704829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:14.706227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:14.745740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:14.777739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 990/1970] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:14.785884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.786169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.786465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.806920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:14.808325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:14.816746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 981/1971] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:14.821747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:14.834908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fada23f-8caa-4e4b-97a7-57f77cc5fdfe None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:14.840774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:14.841442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.841724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.841970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.842709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:14.843012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:14.844676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:14.861430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 991/1972] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:14.862867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:14.873149 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e98b-348b-4196-8187-2277c19a847b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:14.878656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:14.879359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.879641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.879911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.880607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:14.882571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:14.914118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 982/1973] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:14 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:14.915240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:14.929189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46413a1-98d3-4305-b0e7-9a7dd0cc68ba admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:14.991608 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:14.992323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:14.992797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:14.993079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:14.995475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:14.995882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.024222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 992/1974] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:14 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:15.026760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.029347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.031214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:15.041897 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349af6c1-9222-438c-a1b2-b306d0cd66e5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.047128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.047841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.048126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.048405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.049157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.050821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.054444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5c5e2-0b28-4084-a696-7f9e37acb59a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.064734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.065983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.066314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.066590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] PATH_INFO: `/v3/users/efadaae64ba74d28874ec6e68a3b6f1f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.068113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=efadaae64ba74d28874ec6e68a3b6f1f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.070392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.078029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 993/1975] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:18:15.078779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:15.081528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.097892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c287dc-301a-431a-884b-e418fc4de573 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.103554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.104650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.104938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.105215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.105943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.108473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.121081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 994/1976] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:15.125286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.135638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b4f5d-7df9-4d4e-9370-2b469de347ce admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.140409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14baf-776d-4f63-929d-15a96a2dcc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.141322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efadaae64ba74d28874ec6e68a3b6f1f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.141448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14baf-776d-4f63-929d-15a96a2dcc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.141846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14baf-776d-4f63-929d-15a96a2dcc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.142186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14baf-776d-4f63-929d-15a96a2dcc5b admin admin] PATH_INFO: `/v3/projects/2aca09e1a3bc4926ba6c14f975728e39/users/63c237a15880463d9b3850dac6413ceb/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.152960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efadaae64ba74d28874ec6e68a3b6f1f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.153963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efadaae64ba74d28874ec6e68a3b6f1f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.154917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efadaae64ba74d28874ec6e68a3b6f1f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.161664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14baf-776d-4f63-929d-15a96a2dcc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aca09e1a3bc4926ba6c14f975728e39, user_id=63c237a15880463d9b3850dac6413ceb, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.164530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e14baf-776d-4f63-929d-15a96a2dcc5b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.172589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6877efef-283b-4806-b8aa-78fbea2609ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efadaae64ba74d28874ec6e68a3b6f1f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.184192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 995/1977] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:15 2022] PUT /identity/v3/projects/2aca09e1a3bc4926ba6c14f975728e39/users/63c237a15880463d9b3850dac6413ceb/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:15.189673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.189966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.190321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.201051 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 983/1978] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:15 2022] DELETE /identity/v3/users/efadaae64ba74d28874ec6e68a3b6f1f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:15.203878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.204172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.204448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.211134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:15.212377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:15.231756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:15.233493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:15.303446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 996/1979] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:15.313761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.316001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:15.327925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:15.328783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 984/1980] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:15.340099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.341556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:15.395929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92cfed-6a32-4259-85fe-13bab329e7db None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.401070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.401769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.402020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.402294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.413359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.414148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301c6df-9ff5-48ca-9303-3076ec0bd373 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.414864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.419394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.420058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.420341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.420615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.428336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 997/1981] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:18:15.432460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.433992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.447677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 985/1982] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:15.862264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:15.864378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:15.879632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3ce3-c215-4869-b57e-c67caa4e020c service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:15.890319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:15.891370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:15.891737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:15.892174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] PATH_INFO: `/v3/projects/5c23d941ecde4fc39a3c1eacf3f24970` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:15.893832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c23d941ecde4fc39a3c1eacf3f24970)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:15.896956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:15.961497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c23d941ecde4fc39a3c1eacf3f24970', 'request_id': 'req-cdcc4174-0c9f-40ca-8639-f58b702d4221'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.969370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c23d941ecde4fc39a3c1eacf3f24970', 'request_id': 'req-cdcc4174-0c9f-40ca-8639-f58b702d4221'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.977536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c23d941ecde4fc39a3c1eacf3f24970', 'request_id': 'req-cdcc4174-0c9f-40ca-8639-f58b702d4221'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.994613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] The token cache is being invalidate because project 5c23d941ecde4fc39a3c1eacf3f24970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:15.994935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.995696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-cdcc4174-0c9f-40ca-8639-f58b702d4221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:15.997329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 998/1983] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:15 2022] DELETE /identity/v3/projects/5c23d941ecde4fc39a3c1eacf3f24970 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:16.002373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:16.015275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3e0ec-fc59-4da6-8fdc-605e357a0c2d service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:16.042912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:16.079004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:16.079937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:16.080222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:16.080495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] PATH_INFO: `/v3/users/0b0f3f6400474277b1a08bae93bbd3f1` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:16.081757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b0f3f6400474277b1a08bae93bbd3f1)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:16.083805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:16.134699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b0f3f6400474277b1a08bae93bbd3f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:16.144546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b0f3f6400474277b1a08bae93bbd3f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:16.145170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b0f3f6400474277b1a08bae93bbd3f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:16.145764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b0f3f6400474277b1a08bae93bbd3f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:16.157898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b0f3f6400474277b1a08bae93bbd3f1'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:16.171398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 986/1984] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:16 2022] DELETE /identity/v3/users/0b0f3f6400474277b1a08bae93bbd3f1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:16.365163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:16.366141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:16.366688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:16.407440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] MFA Rules not processed for user `63c237a15880463d9b3850dac6413ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:16.409220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:16.518386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 999/1985] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:16.529959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:16.531557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:16.612203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1d6a7-f3e7-46ab-85a2-7c1352e1f0ec admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:16.616233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:16.616963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:16.617253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:16.617527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:16.626287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:16.627915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:16.637236 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 987/1986] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:16.838484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:16.840042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:16.855649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:16.857067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:16.897949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:16.934429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:16.958093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446585fd-19cb-4a53-91f0-80dc2c03a2cb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:16.960597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00f5d9-2ca1-4394-bd03-8f556f3b5baf service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:16.965450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:16.966374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:16.966686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:16.966929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] PATH_INFO: `/v3/users/b5978aa87de7495c9795beb8aa3c7389` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:16.968160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5978aa87de7495c9795beb8aa3c7389)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:16.969497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:16.970438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:16.970852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:16.971323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:16.972211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] PATH_INFO: `/v3/projects/f94b5749bc8f4fde954ac35516d12498` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:16.974185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94b5749bc8f4fde954ac35516d12498)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:16.976521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:17.034952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5978aa87de7495c9795beb8aa3c7389'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.038580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94b5749bc8f4fde954ac35516d12498', 'request_id': 'req-add88d4b-ed5b-4a55-999f-f69840c97fcd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.046380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94b5749bc8f4fde954ac35516d12498', 'request_id': 'req-add88d4b-ed5b-4a55-999f-f69840c97fcd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.047311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5978aa87de7495c9795beb8aa3c7389'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.048138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5978aa87de7495c9795beb8aa3c7389'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.048749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5978aa87de7495c9795beb8aa3c7389'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.052207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94b5749bc8f4fde954ac35516d12498', 'request_id': 'req-add88d4b-ed5b-4a55-999f-f69840c97fcd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.062717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a526dbaa-a477-4c89-ac86-3580d12d9e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5978aa87de7495c9795beb8aa3c7389'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.066118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] The token cache is being invalidate because project f94b5749bc8f4fde954ac35516d12498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:17.066416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.067277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.070799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1000/1987] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:16 2022] DELETE /identity/v3/projects/f94b5749bc8f4fde954ac35516d12498 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:17.074937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:17.076102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 988/1988] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:16 2022] DELETE /identity/v3/users/b5978aa87de7495c9795beb8aa3c7389 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:17.076570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:17.080761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:17.081227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:17.081382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:17.100437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:17.101620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:17.152723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add88d4b-ed5b-4a55-999f-f69840c97fcd admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:17.190988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 989/1989] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:17.199356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:17.200864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:17.221249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:17.222369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:17.222720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:17.223209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] PATH_INFO: `/v3/users/adf2793bd7cb4b009c7fb5ea1848b626` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:17.224819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf2793bd7cb4b009c7fb5ea1848b626)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:17.227062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:17.229430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:17.273408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbff50-0c64-48c9-9ed0-5850d50628d4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:17.277187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:17.277886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:17.278173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:17.278463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:17.283960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf2793bd7cb4b009c7fb5ea1848b626'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.284802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf2793bd7cb4b009c7fb5ea1848b626'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.285632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf2793bd7cb4b009c7fb5ea1848b626'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.288208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:17.290392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:17.298920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf2793bd7cb4b009c7fb5ea1848b626'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.301757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 990/1990] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:18:17.316749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf2793bd7cb4b009c7fb5ea1848b626'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.332323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1001/1991] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:17 2022] DELETE /identity/v3/users/adf2793bd7cb4b009c7fb5ea1848b626 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:17.795949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:17.798145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:17.837160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b32e-793b-495f-8944-551adabc01a2 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:17.850523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:17.850644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:17.852677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:17.915325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:17.916508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:17.916789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:17.917059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] PATH_INFO: `/v3/projects/53fa22c45e6041d3aceaa62949eb347b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:17.918263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fa22c45e6041d3aceaa62949eb347b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:17.920361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:17.945708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9675f-67b0-4723-9b92-8045a6839f8e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:17.951890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:17.952783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:17.953099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:17.953404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] PATH_INFO: `/v3/projects/57b6e67dd6b14b5fb2f0ec4e0d17e020` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:17.955111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b6e67dd6b14b5fb2f0ec4e0d17e020)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:17.957216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:17.980437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fa22c45e6041d3aceaa62949eb347b', 'request_id': 'req-2e94918c-1862-4e9b-bd3b-1953ed7e2142'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.992104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fa22c45e6041d3aceaa62949eb347b', 'request_id': 'req-2e94918c-1862-4e9b-bd3b-1953ed7e2142'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:17.999056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fa22c45e6041d3aceaa62949eb347b', 'request_id': 'req-2e94918c-1862-4e9b-bd3b-1953ed7e2142'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.011361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b6e67dd6b14b5fb2f0ec4e0d17e020', 'request_id': 'req-d4269ca5-e2db-4231-84ee-3fee829677ed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.020591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b6e67dd6b14b5fb2f0ec4e0d17e020', 'request_id': 'req-d4269ca5-e2db-4231-84ee-3fee829677ed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.030284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b6e67dd6b14b5fb2f0ec4e0d17e020', 'request_id': 'req-d4269ca5-e2db-4231-84ee-3fee829677ed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.033951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] The token cache is being invalidate because project 53fa22c45e6041d3aceaa62949eb347b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:18.034249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.036962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2e94918c-1862-4e9b-bd3b-1953ed7e2142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.038813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 991/1992] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:17 2022] DELETE /identity/v3/projects/53fa22c45e6041d3aceaa62949eb347b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:18.044953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4cb7e-f595-474a-9d59-4513287bf024 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.045357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4cb7e-f595-474a-9d59-4513287bf024 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.045637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4cb7e-f595-474a-9d59-4513287bf024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.061575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] The token cache is being invalidate because project 57b6e67dd6b14b5fb2f0ec4e0d17e020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:18.062209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.063047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d4269ca5-e2db-4231-84ee-3fee829677ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:18.070013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-39b4cb7e-f595-474a-9d59-4513287bf024 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.070013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-39b4cb7e-f595-474a-9d59-4513287bf024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.070853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1002/1993] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:17 2022] DELETE /identity/v3/projects/57b6e67dd6b14b5fb2f0ec4e0d17e020 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:18.072774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1ce3-ae17-45a6-979e-972f9b1b294b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.073210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1ce3-ae17-45a6-979e-972f9b1b294b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.073632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1ce3-ae17-45a6-979e-972f9b1b294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.101571 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-551b1ce3-ae17-45a6-979e-972f9b1b294b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.102841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-551b1ce3-ae17-45a6-979e-972f9b1b294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.118485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:18.201710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 992/1994] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:18.201710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.201710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.201710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.203288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1003/1995] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:18.205277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98186-d136-4d1a-ad45-166cd6ee04e4 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.206200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98186-d136-4d1a-ad45-166cd6ee04e4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.206683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf98186-d136-4d1a-ad45-166cd6ee04e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.217447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] MFA Rules not processed for user `63c237a15880463d9b3850dac6413ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.218656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.231642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-adf98186-d136-4d1a-ad45-166cd6ee04e4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.233119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-adf98186-d136-4d1a-ad45-166cd6ee04e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.249580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1004/1996] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:18.249580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.249580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.249580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.260914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:18.274848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.276178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.285570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1005/1997] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:18.286355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.287955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 993/1998] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:18.298448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.305848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e13e00-6961-4afb-be70-9636c840faa4 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.312706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.313604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.314269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.314929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.316139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:18.316674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.318871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.335199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72e752-d8ba-4bbd-be10-5daa4e6c0141 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.338335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1006/1999] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:18.340133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.340810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.341088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.341384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.342348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:18.342656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.343842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.350003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.365455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d89ad4-da3b-465c-b8a1-b9709cc96cfe admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.379955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.380142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 994/2000] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:18.381105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.381841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.384379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.384826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.385380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.391697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.393439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf213-e8cc-4271-aab8-2b3253c73e03 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.399092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.399985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.400358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.400723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.401502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.404127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.437883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1007/2001] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:18.439226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.450716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 995/2002] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:18.451972 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.529854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a027cc-1327-4609-a52a-7dfb31c859fe admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.536927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.537868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.538300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.538722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.539002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f6a7-3bf6-45fc-a071-477dfed3d83c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.539746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.544730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.545448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.545566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.545950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.546314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.547117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.549970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.576864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1008/2003] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:18.577080 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 996/2004] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:18.581422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.581591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.594117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e113e-b2c1-4cfa-b2ee-6e472c79579a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.594965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60967ebe-7842-4073-a6be-ca703bb387f2 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.600330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.601798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.602074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.602196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.602489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.603025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.603413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.603518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.603744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.604582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.605978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.607223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.621046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 997/2005] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:18.621473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1009/2006] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:18.625547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.626612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.637914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d793b-85a2-4995-815a-fb9c7550f921 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.644290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.644586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03785eeb-951d-4fdf-930a-253bc04695d3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.645326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.645615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.646115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.646972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.648930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.650489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.650995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.651380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.651722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.652518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.654864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.662417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1010/2007] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:18.667665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.674217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 998/2008] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:18.675334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.678862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211888-b147-4abf-b661-2c313a46db06 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.685361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a9c40-d4d6-448b-a7dd-768e4c823123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.687498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9c40-d4d6-448b-a7dd-768e4c823123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.688070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9c40-d4d6-448b-a7dd-768e4c823123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.688365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a12fe-93cf-4804-adc9-fcc05a482543 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:18.689564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a9c40-d4d6-448b-a7dd-768e4c823123 admin admin] PATH_INFO: `/v3/projects/9bc13272dab7442cbdf3e30d5d48ff3b/users/4fefaf24be404206a8b6e00bbd438135/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.699617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fea957-79ad-4212-94c3-389c0b704a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:18.700526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea957-79ad-4212-94c3-389c0b704a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.700809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea957-79ad-4212-94c3-389c0b704a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.701082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea957-79ad-4212-94c3-389c0b704a24 admin admin] PATH_INFO: `/v3/projects/3946083e43254a0a8d4733855e9d8063/users/4de653be6df34951abac82907fa882ee/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.713823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a9c40-d4d6-448b-a7dd-768e4c823123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc13272dab7442cbdf3e30d5d48ff3b, user_id=4fefaf24be404206a8b6e00bbd438135, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.718132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a9c40-d4d6-448b-a7dd-768e4c823123 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.720273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fea957-79ad-4212-94c3-389c0b704a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3946083e43254a0a8d4733855e9d8063, user_id=4de653be6df34951abac82907fa882ee, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:18.723580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fea957-79ad-4212-94c3-389c0b704a24 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:18.736809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1011/2009] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:18 2022] PUT /identity/v3/projects/9bc13272dab7442cbdf3e30d5d48ff3b/users/4fefaf24be404206a8b6e00bbd438135/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:18.739669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 999/2010] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:18 2022] PUT /identity/v3/projects/3946083e43254a0a8d4733855e9d8063/users/4de653be6df34951abac82907fa882ee/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:18.748583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.748931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.749214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.758349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:18.758903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:18.759755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:18.759755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:18.789603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] MFA Rules not processed for user `4fefaf24be404206a8b6e00bbd438135`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.791495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.792959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] MFA Rules not processed for user `4de653be6df34951abac82907fa882ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:18.794592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.879456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:18.924765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1000/2011] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:18.926132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:18.928022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:18.961498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1012/2012] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:18.967364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.016396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c05cfb-1344-4aa9-bb33-fc2a2539e38c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.028788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.029606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.030030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.030309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.052074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.054469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.071291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1001/2013] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:19.080350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f6e2-70d9-42f0-9d9c-c73755c44874 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.086389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.087170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.087462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.087748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.088434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.090463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.122353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1013/2014] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:18 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:19.126060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.142954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea025bd-bbe6-40e9-a06a-34f5251669f6 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.216422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.217228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.217975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.217975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.218870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.221057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.250583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1002/2015] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:19 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:19.255682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.270512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405bb58-eebe-4c23-a66b-f271fbbbf51c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.275650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.276450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.276737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.277014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.277920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.279696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.292625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1014/2016] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:19.297282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.312881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e940822-bca2-440e-867d-dafb8c0fa6fe admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.318955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.320441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.321223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.321483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] PATH_INFO: `/v3/projects/63aad7b9201c48ecab1880ef84d551a4/users/9aeeea83f9c6489fa796cde162a9a94c/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.353126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63aad7b9201c48ecab1880ef84d551a4, user_id=9aeeea83f9c6489fa796cde162a9a94c, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.356068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.391379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1003/2017] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:19 2022] PUT /identity/v3/projects/63aad7b9201c48ecab1880ef84d551a4/users/9aeeea83f9c6489fa796cde162a9a94c/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:19.396413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.424332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf263a82-0d70-4682-a044-f57c8a815616 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.550657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad363f-ec9c-4250-9cd0-7d59b81680b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.551010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad363f-ec9c-4250-9cd0-7d59b81680b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.551518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad363f-ec9c-4250-9cd0-7d59b81680b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.552509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad363f-ec9c-4250-9cd0-7d59b81680b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.554544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad363f-ec9c-4250-9cd0-7d59b81680b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.556990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad363f-ec9c-4250-9cd0-7d59b81680b8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.571485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1015/2018] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:19.580658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.595116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907da6d-2cd7-4ab1-8ed4-cd47f5454b86 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.603364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.604469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.604942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.605580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] PATH_INFO: `/v3/projects/63aad7b9201c48ecab1880ef84d551a4/users/9aeeea83f9c6489fa796cde162a9a94c/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.608315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63aad7b9201c48ecab1880ef84d551a4, user_id=9aeeea83f9c6489fa796cde162a9a94c, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.611484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.625321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1004/2019] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:19 2022] PUT /identity/v3/projects/63aad7b9201c48ecab1880ef84d551a4/users/9aeeea83f9c6489fa796cde162a9a94c/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:19.636863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.637180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.637724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.646810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:19.672004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] MFA Rules not processed for user `9aeeea83f9c6489fa796cde162a9a94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:19.673330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:19.754878 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1016/2020] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:19.763484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:19.830885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:19.848768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d071317-a101-4ac2-9fa3-f4ea25ff870b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:19.853359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c4eb8-a7d1-47fd-ade6-4b8ac11978cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:19.854022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4eb8-a7d1-47fd-ade6-4b8ac11978cf service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:19.854303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4eb8-a7d1-47fd-ade6-4b8ac11978cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:19.854552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c4eb8-a7d1-47fd-ade6-4b8ac11978cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:19.920148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c4eb8-a7d1-47fd-ade6-4b8ac11978cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:19.921607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c4eb8-a7d1-47fd-ade6-4b8ac11978cf service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:19.932238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1005/2021] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:22.535939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:22.625629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83da66b-eaef-4f1d-bcc7-79a8ef070ebe None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:22.631346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:22.632051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:22.632340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:22.632615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] PATH_INFO: `/v3/users/4de653be6df34951abac82907fa882ee` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:22.643771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de653be6df34951abac82907fa882ee)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:22.646931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:22.719838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de653be6df34951abac82907fa882ee'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:22.720564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de653be6df34951abac82907fa882ee'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:22.721168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de653be6df34951abac82907fa882ee'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:22.729412 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de653be6df34951abac82907fa882ee'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:22.748206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de653be6df34951abac82907fa882ee'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:22.762079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1017/2022] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:22 2022] DELETE /identity/v3/users/4de653be6df34951abac82907fa882ee => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:22.766844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36416-755f-4231-9e1e-c125f711733d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:22.767384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36416-755f-4231-9e1e-c125f711733d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:22.767462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36416-755f-4231-9e1e-c125f711733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:22.785451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dba36416-755f-4231-9e1e-c125f711733d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:22.786797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dba36416-755f-4231-9e1e-c125f711733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:22.859253 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1006/2023] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:22.870605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:22.872286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:22.884486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:22.947898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7ba42-43f6-46eb-985a-7132e6f36c27 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:22.952329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176a6c9-dcd5-4417-aee1-79fb66d189b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:22.953000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a6c9-dcd5-4417-aee1-79fb66d189b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:22.953325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a6c9-dcd5-4417-aee1-79fb66d189b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:22.953601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a6c9-dcd5-4417-aee1-79fb66d189b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:22.966062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176a6c9-dcd5-4417-aee1-79fb66d189b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:22.967743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176a6c9-dcd5-4417-aee1-79fb66d189b1 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:22.978992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1018/2024] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:18:23.341845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36416-755f-4231-9e1e-c125f711733d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:23.343864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dba36416-755f-4231-9e1e-c125f711733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:23.358908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36416-755f-4231-9e1e-c125f711733d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:23.365389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:23.366916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.367566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.368011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] PATH_INFO: `/v3/projects/3946083e43254a0a8d4733855e9d8063` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.370407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3946083e43254a0a8d4733855e9d8063)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:23.373098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:23.499452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3946083e43254a0a8d4733855e9d8063', 'request_id': 'req-150e0f35-36a0-4910-b279-09320401d390'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:23.507832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3946083e43254a0a8d4733855e9d8063', 'request_id': 'req-150e0f35-36a0-4910-b279-09320401d390'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:23.516606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3946083e43254a0a8d4733855e9d8063', 'request_id': 'req-150e0f35-36a0-4910-b279-09320401d390'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:23.534353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] The token cache is being invalidate because project 3946083e43254a0a8d4733855e9d8063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:23.534963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:23.539170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-150e0f35-36a0-4910-b279-09320401d390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:23.547257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1007/2025] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:23 2022] DELETE /identity/v3/projects/3946083e43254a0a8d4733855e9d8063 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:23.549268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620872ed-9631-4d00-beff-8f582b77178c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.549895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620872ed-9631-4d00-beff-8f582b77178c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.549895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620872ed-9631-4d00-beff-8f582b77178c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.571253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-620872ed-9631-4d00-beff-8f582b77178c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:23.572172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-620872ed-9631-4d00-beff-8f582b77178c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:23.662188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1019/2026] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:23.671273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.671776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.672272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.692147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:23.693498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:23.703245 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1008/2027] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:23.707485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620872ed-9631-4d00-beff-8f582b77178c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:23.719035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620872ed-9631-4d00-beff-8f582b77178c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:23.724894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:23.725707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.726060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.726427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.727270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:23.727692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:23.729375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:23.744890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1020/2028] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:23.749260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:23.758810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b985dc-8e6c-40ff-9541-bea65c26f887 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:23.763641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:23.764429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.764712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.764982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.765684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:23.767756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:23.777485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:23.800088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1009/2029] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:23 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:23.803696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:23.815764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02b32f-9d5e-4bd9-b513-7afbdc093a30 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:23.890934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:23.891596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.891872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.892146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.892937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:23.894877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:23.917303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1021/2030] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:23 2022] POST /identity/v3/users => generated 290 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:23.922310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:23.942127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb99528-86ea-49ac-b257-fbf56af30374 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:23.947434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:23.948451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.948814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.949231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:23.950039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:23.952015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:23.973056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1010/2031] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:23.977125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:23.990031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78784091-33c4-4f21-b6fd-acd422c408f5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:23.995864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bd782-0633-489f-9e4b-f0a53b647687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:23.996942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd782-0633-489f-9e4b-f0a53b647687 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:23.997321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd782-0633-489f-9e4b-f0a53b647687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:23.998942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bd782-0633-489f-9e4b-f0a53b647687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:24.000349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bd782-0633-489f-9e4b-f0a53b647687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:24.003066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bd782-0633-489f-9e4b-f0a53b647687 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:24.014103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1022/2032] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:24.018314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:24.029368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24fb38-cf77-4a1f-acf7-e3d6b53c93be admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:24.034070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:24.035044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:24.035360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:24.035632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] PATH_INFO: `/v3/projects/01367a52e9104f85baec4b18ef8bf258/users/7da83fc4029c4cdebca07c7247669bd0/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:24.055841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01367a52e9104f85baec4b18ef8bf258, user_id=7da83fc4029c4cdebca07c7247669bd0, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:24.058536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:24.082217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1011/2033] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:24 2022] PUT /identity/v3/projects/01367a52e9104f85baec4b18ef8bf258/users/7da83fc4029c4cdebca07c7247669bd0/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:24.087223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:24.087633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:24.087922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:24.107599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:24.109022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:24.122775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:24.177166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1023/2034] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:24.187287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:24.189145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:24.254418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d942d-98e5-4fee-afcf-5d403c486b76 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:24.259897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:24.260575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:24.260861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:24.261138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:24.274642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:24.276192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:24.286372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1012/2035] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:18:24.640285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:24.642970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:24.748011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f797493-2c69-4f1c-9fdf-0cb46a2c5256 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:24.753807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:24.754534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:24.754917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:24.755408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:24.758387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:24.921855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:24.923455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:24.954015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1024/2036] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:27.856788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:27.858715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:27.878325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d057b4-c4bc-41e5-beb7-3feef331e6fc service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:27.884131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:27.885284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:27.885875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:27.886290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] PATH_INFO: `/v3/users/1cb5512dbadb4b70b030e7e3bb297dad` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:27.887769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb5512dbadb4b70b030e7e3bb297dad)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:27.889895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:27.965600 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb5512dbadb4b70b030e7e3bb297dad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:27.982127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb5512dbadb4b70b030e7e3bb297dad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:27.983326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb5512dbadb4b70b030e7e3bb297dad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:27.984167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb5512dbadb4b70b030e7e3bb297dad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.032646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f48b5171-0bf6-4a49-9a54-25db5d07b14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb5512dbadb4b70b030e7e3bb297dad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.054985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1013/2037] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:27 2022] DELETE /identity/v3/users/1cb5512dbadb4b70b030e7e3bb297dad => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:28.334474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:28.351205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cde6bd-590d-4e3b-bf27-a17372173555 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:28.429007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:28.430940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.431257 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.431538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] PATH_INFO: `/v3/projects/fabcb11a7be746719029396d4abab6cc` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.432793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fabcb11a7be746719029396d4abab6cc)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:28.434727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:28.448610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:28.504827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fabcb11a7be746719029396d4abab6cc', 'request_id': 'req-c3830aad-57a6-476e-9cd7-5326bd08b910'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.514403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fabcb11a7be746719029396d4abab6cc', 'request_id': 'req-c3830aad-57a6-476e-9cd7-5326bd08b910'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.522803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fabcb11a7be746719029396d4abab6cc', 'request_id': 'req-c3830aad-57a6-476e-9cd7-5326bd08b910'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.538895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] The token cache is being invalidate because project fabcb11a7be746719029396d4abab6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:28.539240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.540365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c3830aad-57a6-476e-9cd7-5326bd08b910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:28.543031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1025/2038] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:28 2022] DELETE /identity/v3/projects/fabcb11a7be746719029396d4abab6cc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:28.547807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.548096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.548371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.567809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:28.569078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:28.599505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:28.652589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1014/2039] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:28.654724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.655265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.655770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.678566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:28.680287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:28.691542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1026/2040] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:28.695868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:28.712684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f9cc3-b9d0-481a-8a6a-fe881446b9f9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:28.721450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:28.722223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.722567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.722910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.723780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:28.724128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:28.726152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:28.743890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1015/2041] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:28.749182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:28.760648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7c949-a570-445f-bdba-dcf999c64a87 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:28.765648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:28.766313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.766590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.766866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.767578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:28.769683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:28.813568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1027/2042] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:28 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:28.818230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:28.830247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339b259-704f-4041-9eb2-a111582b828f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:28.921451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:28.922193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.922477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.922897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.923628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:28.925801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:28.959815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1016/2043] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:28 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:28.963920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:28.974383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba3df-c783-45a0-81c9-1e0cdb34a7dd admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:28.979198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:28.979903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:28.980187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:28.980463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:28.981193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:28.983346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:28.994978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1028/2044] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:28.999047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:29.018927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c56e9-e7f7-4bd8-959c-18ff5b955d92 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:29.028641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97241ab9-c983-4234-a89c-110603bb65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:29.029358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241ab9-c983-4234-a89c-110603bb65de admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:29.029646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241ab9-c983-4234-a89c-110603bb65de admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:29.030099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97241ab9-c983-4234-a89c-110603bb65de admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:29.030964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97241ab9-c983-4234-a89c-110603bb65de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:29.033598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97241ab9-c983-4234-a89c-110603bb65de admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:29.049010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1017/2045] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:29.054213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:29.070770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f089-f9b6-4ee9-8bc1-503114fa5301 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:29.076623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:29.077750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:29.078029 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:29.078304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] PATH_INFO: `/v3/projects/7ca5b81a34724b8c977ce0497e363b4f/users/1b3c35d89f2b498ea993ecc4cf4f5268/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:29.105586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca5b81a34724b8c977ce0497e363b4f, user_id=1b3c35d89f2b498ea993ecc4cf4f5268, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:29.138528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:29.170107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1029/2046] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:29 2022] PUT /identity/v3/projects/7ca5b81a34724b8c977ce0497e363b4f/users/1b3c35d89f2b498ea993ecc4cf4f5268/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:29.178001 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:29.178516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:29.179468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:29.242656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] MFA Rules not processed for user `1b3c35d89f2b498ea993ecc4cf4f5268`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:29.244146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:29.453305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1018/2047] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:29.474560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:29.479700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:29.603044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2ee31-64d4-40ad-ba60-a7304a46a682 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:29.612180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de89ef0-787e-40c5-9572-2aa080a2f842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:29.613109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de89ef0-787e-40c5-9572-2aa080a2f842 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:29.613490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de89ef0-787e-40c5-9572-2aa080a2f842 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:29.614155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de89ef0-787e-40c5-9572-2aa080a2f842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:29.628331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de89ef0-787e-40c5-9572-2aa080a2f842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:29.630600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de89ef0-787e-40c5-9572-2aa080a2f842 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:29.643329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1030/2048] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:29.901367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:29.946190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:29.991414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3df86-5db5-4d63-9b7b-a03746fb0b06 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:29.997406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:29.998314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:29.998597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:29.998871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] PATH_INFO: `/v3/users/1b3c35d89f2b498ea993ecc4cf4f5268` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.000323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3c35d89f2b498ea993ecc4cf4f5268)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:30.002502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:30.080652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3c35d89f2b498ea993ecc4cf4f5268'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.092992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3c35d89f2b498ea993ecc4cf4f5268'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.093628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3c35d89f2b498ea993ecc4cf4f5268'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.094228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3c35d89f2b498ea993ecc4cf4f5268'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.109000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3c35d89f2b498ea993ecc4cf4f5268'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.121484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1019/2049] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:29 2022] DELETE /identity/v3/users/1b3c35d89f2b498ea993ecc4cf4f5268 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:30.126037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.126330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.126600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.145096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:30.146293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.159773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:30.216624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1031/2050] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:30.226489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:30.227894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.287054 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b47ef-1316-4ab6-8da3-f539623f1f0f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:30.290886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba767c-5b51-49eb-8526-ffc1d3ff1e34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:30.291936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba767c-5b51-49eb-8526-ffc1d3ff1e34 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.292222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba767c-5b51-49eb-8526-ffc1d3ff1e34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.292535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba767c-5b51-49eb-8526-ffc1d3ff1e34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.302965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba767c-5b51-49eb-8526-ffc1d3ff1e34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:30.304484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba767c-5b51-49eb-8526-ffc1d3ff1e34 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:30.315991 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1020/2051] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:30.432503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:30.434303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.447666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2ac4-daf3-4044-aa5f-eb5b773f7595 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:30.452718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:30.453631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.453887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.454156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] PATH_INFO: `/v3/users/4fefaf24be404206a8b6e00bbd438135` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.455464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fefaf24be404206a8b6e00bbd438135)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:30.457644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:30.528655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fefaf24be404206a8b6e00bbd438135'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.529777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fefaf24be404206a8b6e00bbd438135'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.530415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fefaf24be404206a8b6e00bbd438135'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.540728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fefaf24be404206a8b6e00bbd438135'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.573174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b936ff3f-90f5-430b-bc9d-901dba02f24a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fefaf24be404206a8b6e00bbd438135'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.596077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1032/2052] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:30 2022] DELETE /identity/v3/users/4fefaf24be404206a8b6e00bbd438135 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:30.600141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.600453 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.600732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.626033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:30.626710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.627003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.627313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.631601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.684763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] MFA Rules not processed for user `7da83fc4029c4cdebca07c7247669bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:30.687328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.738361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:30.767263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1021/2053] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:30.767263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:30.769614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.783568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd062d-99a3-41da-ad9f-d0bf2aafa48d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:30.788553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:30.789433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.789710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.789980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] PATH_INFO: `/v3/projects/7ca5b81a34724b8c977ce0497e363b4f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.791527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca5b81a34724b8c977ce0497e363b4f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:30.793488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:30.795705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1033/2054] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:30.796622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:30.798613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.835193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:30.855485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca5b81a34724b8c977ce0497e363b4f', 'request_id': 'req-44bf701f-ed16-42e8-ba0e-7c0fd39de045'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.864275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca5b81a34724b8c977ce0497e363b4f', 'request_id': 'req-44bf701f-ed16-42e8-ba0e-7c0fd39de045'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.872883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca5b81a34724b8c977ce0497e363b4f', 'request_id': 'req-44bf701f-ed16-42e8-ba0e-7c0fd39de045'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.875287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5f9f-cfaa-4fdc-aa44-0e98e4f856e4 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:30.894836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] The token cache is being invalidate because project 7ca5b81a34724b8c977ce0497e363b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:30.895235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.895996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:30.898469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1022/2055] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:30 2022] DELETE /identity/v3/projects/7ca5b81a34724b8c977ce0497e363b4f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:30.898950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:30.900722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.943640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:30.944303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:30.944593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:30.944871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:30.947265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:30.997460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf701f-ed16-42e8-ba0e-7c0fd39de045 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.002523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a80cec-2b00-4902-8973-1ac4b0d1ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.003251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a80cec-2b00-4902-8973-1ac4b0d1ddbf admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.003538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a80cec-2b00-4902-8973-1ac4b0d1ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.003817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a80cec-2b00-4902-8973-1ac4b0d1ddbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.004514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a80cec-2b00-4902-8973-1ac4b0d1ddbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.006657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a80cec-2b00-4902-8973-1ac4b0d1ddbf admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.027244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.028733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.035050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1023/2056] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:30 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:31.036495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34acc8d-c5fb-4692-871e-64281590cc2e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.036786 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34acc8d-c5fb-4692-871e-64281590cc2e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.037064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34acc8d-c5fb-4692-871e-64281590cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.042134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1034/2057] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:31.042966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.052697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9b76-6aa0-4628-9f84-72d839bb07e1 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.056412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f34acc8d-c5fb-4692-871e-64281590cc2e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:31.057620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f34acc8d-c5fb-4692-871e-64281590cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:31.152773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:31.163991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.166112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.167309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.167642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.168373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.172348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.183000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1024/2058] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:31.191227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.191520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.191801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.214586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1035/2059] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:31 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:31.216487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:31.217839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:31.218893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.229999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1025/2060] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:31.231440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0f483-763d-44f1-9a57-1fb1ca38d7e0 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.235057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.243395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.245465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.246003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.246512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.257011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08015a90-c9b3-4848-87ab-1c4f9d16c6c0 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.260235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.261880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.262271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.262536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.262821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.263238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.263901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:31.264265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.266014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.276018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1036/2061] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:31.280493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.285074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1026/2062] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:18:31.286067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.292123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adfe5-3615-442d-a904-0a2a60c831eb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.297861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.298190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2516fd-ca5d-45e7-8c2b-0c91fe45dc98 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.298873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.299319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.299673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] PATH_INFO: `/v3/projects/c470e629abac4ab9975657d55c2347e6/users/b57ce75dd2c049f6954779ef6bea6e1e/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.302340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:31.304755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.305424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.305778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.306152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.307103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.309173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.325813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c470e629abac4ab9975657d55c2347e6, user_id=b57ce75dd2c049f6954779ef6bea6e1e, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.328942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.349562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1037/2063] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:31 2022] PUT /identity/v3/projects/c470e629abac4ab9975657d55c2347e6/users/b57ce75dd2c049f6954779ef6bea6e1e/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:31.354248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.356798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1027/2064] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:31.361315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.456629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c036d-92ed-446a-9c6e-b1eba3f6b4df admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.461720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.462506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.462786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.463056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.463855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.466135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.472086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a050-c107-4264-87c8-4ce277bfabdf admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.480497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1038/2065] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:31.481601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.481857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.484120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.484455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.484842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.485575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.488971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.492361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ebe84-c81b-44b7-ba5b-d0bb7ede7581 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.498601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.499655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.499941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.500221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] PATH_INFO: `/v3/projects/c470e629abac4ab9975657d55c2347e6/users/b57ce75dd2c049f6954779ef6bea6e1e/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.502927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c470e629abac4ab9975657d55c2347e6, user_id=b57ce75dd2c049f6954779ef6bea6e1e, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.505733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.525009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1039/2066] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:31 2022] PUT /identity/v3/projects/c470e629abac4ab9975657d55c2347e6/users/b57ce75dd2c049f6954779ef6bea6e1e/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:31.531227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1028/2067] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:31 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:31.536907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.550839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.554666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:31.569303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dc0f9-f6c6-4889-8677-739b351e57b1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.645891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.647268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.647760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.648304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] PATH_INFO: `/v3/projects/9bc13272dab7442cbdf3e30d5d48ff3b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.648825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35dc27-cca1-41e6-8728-869a64ae4157 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.650193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc13272dab7442cbdf3e30d5d48ff3b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.653927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.655853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.657459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.657983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.658275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.659174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.661395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.679477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1040/2068] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:31.683480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.710147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8fe40-3da3-42d9-b53a-3fef1b8781ca admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.720589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:31.729783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc13272dab7442cbdf3e30d5d48ff3b', 'request_id': 'req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.741341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc13272dab7442cbdf3e30d5d48ff3b', 'request_id': 'req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.750831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc13272dab7442cbdf3e30d5d48ff3b', 'request_id': 'req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.771423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] The token cache is being invalidate because project 9bc13272dab7442cbdf3e30d5d48ff3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:31.772125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.773736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.779467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1029/2069] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:31 2022] DELETE /identity/v3/projects/9bc13272dab7442cbdf3e30d5d48ff3b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:31.780532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.782054 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:31.796876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.797913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.798720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.799120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.800024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.801885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.806390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:31.820197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1041/2070] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:31.825173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:31.830089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:31.852301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40efd7-61ba-4ca5-9794-b8a5b1141044 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.863092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031e8c8-cb77-4512-9b8e-55ab6401816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.864354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031e8c8-cb77-4512-9b8e-55ab6401816e admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.864821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031e8c8-cb77-4512-9b8e-55ab6401816e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.865209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031e8c8-cb77-4512-9b8e-55ab6401816e admin admin] PATH_INFO: `/v3/projects/c0e2ff0ce0eb4a5a8279fb013fe6ffba/users/3f306abea61f4b3d8146f7f40ba69cca/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.879244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701b1f-a440-4bd3-9b0c-d70d439ea5c8 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:31.885761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:31.887032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.887450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.887875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031e8c8-cb77-4512-9b8e-55ab6401816e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e2ff0ce0eb4a5a8279fb013fe6ffba, user_id=3f306abea61f4b3d8146f7f40ba69cca, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.888461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] PATH_INFO: `/v3/users/9aeeea83f9c6489fa796cde162a9a94c` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.890265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aeeea83f9c6489fa796cde162a9a94c)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:31.891830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031e8c8-cb77-4512-9b8e-55ab6401816e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.892642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:31.910750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1042/2071] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:31 2022] PUT /identity/v3/projects/c0e2ff0ce0eb4a5a8279fb013fe6ffba/users/3f306abea61f4b3d8146f7f40ba69cca/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:31.922282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:31.922648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:31.922896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:31.961452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] MFA Rules not processed for user `3f306abea61f4b3d8146f7f40ba69cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:31.962698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:31.970329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aeeea83f9c6489fa796cde162a9a94c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.983635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aeeea83f9c6489fa796cde162a9a94c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.984347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aeeea83f9c6489fa796cde162a9a94c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:31.985159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aeeea83f9c6489fa796cde162a9a94c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.006223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aeeea83f9c6489fa796cde162a9a94c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.023901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1030/2072] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:31 2022] DELETE /identity/v3/users/9aeeea83f9c6489fa796cde162a9a94c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:32.058135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1043/2073] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:32.059212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.065606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:32.168202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:32.193176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77250a20-a5f3-4e14-88c3-857dfc17a65d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.201723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.203668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.204143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.204526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.205798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.209210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:32.280747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1031/2074] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:32 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:32.283122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.370624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6835d1-555e-4662-9f69-3fc348c52e90 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.394040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.396083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:32.467002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.467866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.468226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.468573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.469756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.472427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:32.496413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:32.506325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1044/2075] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:32 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:32.508548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.509704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c716570-1d85-45fd-8a76-cd602a48c5c4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.520393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.521541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.521892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.522207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f69f8-e2f6-46a0-9834-465764606012 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.522316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] PATH_INFO: `/v3/projects/63aad7b9201c48ecab1880ef84d551a4` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.523838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63aad7b9201c48ecab1880ef84d551a4)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.525981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:32.529094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.529862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.530153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.530435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.531185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.533025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:32.547587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1045/2076] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:18:32.548539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.559967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d804668-d84b-4fc3-99b4-93ef475ba7c4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.566037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.566906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.567350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.567659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.568549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.573732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:32.587550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1046/2077] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:32.591679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.594796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63aad7b9201c48ecab1880ef84d551a4', 'request_id': 'req-f9e10515-c4fa-48a3-ac82-24df7761a5d3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.602832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e8615-b540-4bd2-bc5f-3b81e4657dea admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.606524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63aad7b9201c48ecab1880ef84d551a4', 'request_id': 'req-f9e10515-c4fa-48a3-ac82-24df7761a5d3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.619059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63aad7b9201c48ecab1880ef84d551a4', 'request_id': 'req-f9e10515-c4fa-48a3-ac82-24df7761a5d3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.655807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] The token cache is being invalidate because project 63aad7b9201c48ecab1880ef84d551a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:32.656180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.656971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9e10515-c4fa-48a3-ac82-24df7761a5d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:32.659007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1032/2078] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:32 2022] DELETE /identity/v3/projects/63aad7b9201c48ecab1880ef84d551a4 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:32.666574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081011d2-fc64-4f6d-9286-d3ca090fa96a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.666996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081011d2-fc64-4f6d-9286-d3ca090fa96a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.667405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081011d2-fc64-4f6d-9286-d3ca090fa96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.709645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-081011d2-fc64-4f6d-9286-d3ca090fa96a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:32.711424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-081011d2-fc64-4f6d-9286-d3ca090fa96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:32.739236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d0e8b-5788-454d-a4ac-31c1268bf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.740493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d0e8b-5788-454d-a4ac-31c1268bf773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.741026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d0e8b-5788-454d-a4ac-31c1268bf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.741469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d0e8b-5788-454d-a4ac-31c1268bf773 admin admin] PATH_INFO: `/v3/projects/f5b45b084dc74a18813e0bc90b8283dd/users/cc4a40ea8467479199c44d5d2d48cabb/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.761634 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d0e8b-5788-454d-a4ac-31c1268bf773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b45b084dc74a18813e0bc90b8283dd, user_id=cc4a40ea8467479199c44d5d2d48cabb, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.765016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d0e8b-5788-454d-a4ac-31c1268bf773 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:32.790050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1047/2079] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:32 2022] PUT /identity/v3/projects/f5b45b084dc74a18813e0bc90b8283dd/users/cc4a40ea8467479199c44d5d2d48cabb/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:32.804247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.804535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.804821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.810409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1033/2080] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:32.819624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.820415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.820694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.851715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] MFA Rules not processed for user `cc4a40ea8467479199c44d5d2d48cabb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:32.852996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:32.860818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:32.862688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:32.868541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:32.958024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1034/2081] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:32.962201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.973323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ac990-5974-463d-bf40-11004f7f9a4f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:32.976844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1048/2082] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:32.980341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:32.982028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:32.982182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:32.982971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:32.983308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:32.983588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:32.984328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:32.984639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:32.986268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.006997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534d15a-a3b6-43cc-a09a-89b732ccd0ff None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.015260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.016016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.016308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.016586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.019251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.019376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1035/2083] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:33.020265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.021410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.037612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5b3e8-b561-48b7-8da9-8c716271a8d2 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.043456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.044246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.044567 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.044902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.045760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.047987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.062794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1049/2084] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:32 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:33.067447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.086645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1036/2085] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:33 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:33.090952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.110370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:33.158064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f8d30-de6f-4401-bfa6-6a5a94620662 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.200640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fda30-5c8f-4def-a9fc-479c50e406cb admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.214161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.214853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.215132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.215473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.216170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.218119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.238769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.239882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.240449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.240929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.242070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.244970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.251239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1037/2086] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:33 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:33.255075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.267083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d795-6b21-49d2-8c85-0bb0f6380a49 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.274971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.275982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.276334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.276924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.277774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.279611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.279798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1050/2087] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:33 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:33.286611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.292736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1038/2088] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:33.296373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.304563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad236-a61e-4add-9e6d-8fc78a3854bd admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.312844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c373fe5-7390-4708-bac1-a3b16c221c4c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.316775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.320114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.321709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.322318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.323227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.324095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.324439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.324817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.325183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.325589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.329488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.330616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.348838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1051/2089] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:33.359293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.360750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1039/2090] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:18:33.364878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.377081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28729e3-44a7-420c-83c3-8c94a8b6216f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.380223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc5178-24b1-4ade-ba49-43e6c5ec51f6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.382330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc302ea9-7703-40df-9527-a7f7a07205a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.383437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302ea9-7703-40df-9527-a7f7a07205a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.383886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302ea9-7703-40df-9527-a7f7a07205a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.384348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc302ea9-7703-40df-9527-a7f7a07205a4 admin admin] PATH_INFO: `/v3/projects/0698123ada9a460d9d1863d3e6174ad6/users/7f6426984eb846788f60a73b264d0c46/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.387495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.389443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.389795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.390902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] PATH_INFO: `/v3/projects/f524a40b9d64430d95012f4b74867286/users/831a049ab50442b78280e1bd096f97f6/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.402101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc302ea9-7703-40df-9527-a7f7a07205a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0698123ada9a460d9d1863d3e6174ad6, user_id=7f6426984eb846788f60a73b264d0c46, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.405294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc302ea9-7703-40df-9527-a7f7a07205a4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.423038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f524a40b9d64430d95012f4b74867286, user_id=831a049ab50442b78280e1bd096f97f6, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.431208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1040/2091] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:33 2022] PUT /identity/v3/projects/0698123ada9a460d9d1863d3e6174ad6/users/7f6426984eb846788f60a73b264d0c46/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:33.442414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.445178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.445467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.445751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.468732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1052/2092] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:33 2022] PUT /identity/v3/projects/f524a40b9d64430d95012f4b74867286/users/831a049ab50442b78280e1bd096f97f6/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:33.472876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.504521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] MFA Rules not processed for user `7f6426984eb846788f60a73b264d0c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:33.507119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:33.517026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:33.578026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d28c6-18cd-4107-8f47-a91eb179b9f9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.589016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.589962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.590428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.590853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.592337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.602689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.613526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1041/2093] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:33.622042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1053/2094] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:33.624390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.624976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.627435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:33.642420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb13b45-0984-4a48-99c7-4488906e77a5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.649594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb36ac-33ab-4b30-8c18-dbc42004cbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.650528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb36ac-33ab-4b30-8c18-dbc42004cbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.650810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb36ac-33ab-4b30-8c18-dbc42004cbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.651086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb36ac-33ab-4b30-8c18-dbc42004cbaf admin admin] PATH_INFO: `/v3/projects/f524a40b9d64430d95012f4b74867286/users/831a049ab50442b78280e1bd096f97f6/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.656046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb36ac-33ab-4b30-8c18-dbc42004cbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f524a40b9d64430d95012f4b74867286, user_id=831a049ab50442b78280e1bd096f97f6, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.660165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb36ac-33ab-4b30-8c18-dbc42004cbaf admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:33.684879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1042/2095] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:33 2022] PUT /identity/v3/projects/f524a40b9d64430d95012f4b74867286/users/831a049ab50442b78280e1bd096f97f6/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:33.696607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.702463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.702893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.708540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:33.755517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beed08d-d851-4891-9f7f-6e6d475c7325 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:33.773681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] MFA Rules not processed for user `831a049ab50442b78280e1bd096f97f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:33.775714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:33.833803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:33.834843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:33.835379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:33.835969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:33.895533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1043/2096] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:33.906638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:33.909987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:33.975701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:33.977630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:34.008036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2592b-bb16-45ba-bdb6-ba396659cbe0 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:34.014638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a508d4f-e31e-4e67-bf56-34ad94276fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:34.016186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508d4f-e31e-4e67-bf56-34ad94276fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:34.016494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1054/2097] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:34.017033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508d4f-e31e-4e67-bf56-34ad94276fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:34.017529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a508d4f-e31e-4e67-bf56-34ad94276fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:34.036630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a508d4f-e31e-4e67-bf56-34ad94276fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:34.038562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a508d4f-e31e-4e67-bf56-34ad94276fd5 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:34.054496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1044/2098] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:18:35.061824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:35.084539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:35.103774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97c829-9f46-4cae-afa0-ffc779b8f7cb service glance] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:35.112559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:35.113255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:35.113670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:35.113965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:35.121748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:35.291471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:35.293047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:35.306583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1055/2099] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:38.380122 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca830e-ad9d-4f27-bb56-1802e12027b3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:38.380671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca830e-ad9d-4f27-bb56-1802e12027b3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:38.381033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca830e-ad9d-4f27-bb56-1802e12027b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:38.413623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-84ca830e-ad9d-4f27-bb56-1802e12027b3 None None] MFA Rules not processed for user `b57ce75dd2c049f6954779ef6bea6e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:38.413623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-84ca830e-ad9d-4f27-bb56-1802e12027b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:38.424813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:38.511232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1045/2100] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:38.528013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:38.529558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:38.580069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:38.666645 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114a588-09ee-4a48-b22c-6303d6c31ef4 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:38.686904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:38.687894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:38.688176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:38.688451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:38.693543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:38.793930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:38.795976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:38.815471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1056/2101] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:39.973935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:39.974891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:39.975340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:39.999472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] MFA Rules not processed for user `63c237a15880463d9b3850dac6413ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:40.001142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:40.075609 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:40.087421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35c121-48e0-4907-b0b5-79cb363f7179 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:40.096523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca242e-5e6a-4d69-b41d-099838537af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:40.097267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca242e-5e6a-4d69-b41d-099838537af6 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:40.097557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca242e-5e6a-4d69-b41d-099838537af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:40.097836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca242e-5e6a-4d69-b41d-099838537af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:40.114394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1046/2102] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:40.184984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca242e-5e6a-4d69-b41d-099838537af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:40.186726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca242e-5e6a-4d69-b41d-099838537af6 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:40.215072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1057/2103] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:42.932254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:43.027594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa41d92-a880-42c2-bb74-88a253be7db8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:43.038695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:43.040401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:43.040913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:43.041696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] PATH_INFO: `/v3/users/3f306abea61f4b3d8146f7f40ba69cca` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:43.043927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f306abea61f4b3d8146f7f40ba69cca)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:43.048200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:43.158900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f306abea61f4b3d8146f7f40ba69cca'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:43.173037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f306abea61f4b3d8146f7f40ba69cca'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:43.174058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f306abea61f4b3d8146f7f40ba69cca'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:43.175438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f306abea61f4b3d8146f7f40ba69cca'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:43.177155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:43.198197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f306abea61f4b3d8146f7f40ba69cca'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:43.211688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1047/2104] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:42 2022] DELETE /identity/v3/users/3f306abea61f4b3d8146f7f40ba69cca => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:43.216371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:43.216881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:43.217047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:43.235789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:43.236975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:43.312704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1058/2105] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:43.323229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:43.324730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:43.386780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3aa6a-fcb4-4485-a78e-d295106fc5b5 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:43.390705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:43.391581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:43.391876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:43.392554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:43.403477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:43.405064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:43.447946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1048/2106] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:44.006861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:44.008405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:44.023733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8f804-b39a-45cc-9973-021763ca65df None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:44.032979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:44.033793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:44.035900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:44.036213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] PATH_INFO: `/v3/projects/c0e2ff0ce0eb4a5a8279fb013fe6ffba` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:44.037637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e2ff0ce0eb4a5a8279fb013fe6ffba)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:44.039635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:44.047246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:44.106738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e2ff0ce0eb4a5a8279fb013fe6ffba', 'request_id': 'req-a3232e50-4abb-402c-98c0-27af93ec995a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.113380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e2ff0ce0eb4a5a8279fb013fe6ffba', 'request_id': 'req-a3232e50-4abb-402c-98c0-27af93ec995a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.125242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e2ff0ce0eb4a5a8279fb013fe6ffba', 'request_id': 'req-a3232e50-4abb-402c-98c0-27af93ec995a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.147826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] The token cache is being invalidate because project c0e2ff0ce0eb4a5a8279fb013fe6ffba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:44.148217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.149206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.151537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1059/2107] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:44 2022] DELETE /identity/v3/projects/c0e2ff0ce0eb4a5a8279fb013fe6ffba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:44.155923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:44.181467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5caf842-2f63-44b3-b5c4-7fe0988bae75 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:44.250107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:44.251104 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:44.251466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:44.251757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] PATH_INFO: `/v3/users/cc4a40ea8467479199c44d5d2d48cabb` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:44.254719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4a40ea8467479199c44d5d2d48cabb)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:44.256774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:44.308044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4a40ea8467479199c44d5d2d48cabb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.315986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4a40ea8467479199c44d5d2d48cabb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.316826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4a40ea8467479199c44d5d2d48cabb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.317506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4a40ea8467479199c44d5d2d48cabb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.330171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4a40ea8467479199c44d5d2d48cabb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.334611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:44.344522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1049/2108] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:44 2022] DELETE /identity/v3/users/cc4a40ea8467479199c44d5d2d48cabb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:44.639849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:44.641448 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:44.665867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3232e50-4abb-402c-98c0-27af93ec995a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:44.748361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:44.749346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:44.749635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:44.749907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] PATH_INFO: `/v3/projects/f5b45b084dc74a18813e0bc90b8283dd` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:44.751083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b45b084dc74a18813e0bc90b8283dd)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:44.753401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:44.800401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b45b084dc74a18813e0bc90b8283dd', 'request_id': 'req-04a57920-1702-4bbc-aacb-42c26343acb9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.809299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b45b084dc74a18813e0bc90b8283dd', 'request_id': 'req-04a57920-1702-4bbc-aacb-42c26343acb9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.815601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b45b084dc74a18813e0bc90b8283dd', 'request_id': 'req-04a57920-1702-4bbc-aacb-42c26343acb9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.836577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] The token cache is being invalidate because project f5b45b084dc74a18813e0bc90b8283dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:44.836839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.837508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.839042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1060/2109] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:44 2022] DELETE /identity/v3/projects/f5b45b084dc74a18813e0bc90b8283dd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:44.843018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:44.844517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:44.857628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9ca51-1801-4072-90ee-775a1aec46a3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:44.918847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:44.919907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:44.920340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:44.920612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] PATH_INFO: `/v3/users/831a049ab50442b78280e1bd096f97f6` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:44.922113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=831a049ab50442b78280e1bd096f97f6)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:44.924297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:44.979685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831a049ab50442b78280e1bd096f97f6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.989603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831a049ab50442b78280e1bd096f97f6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.990630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831a049ab50442b78280e1bd096f97f6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:44.991349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831a049ab50442b78280e1bd096f97f6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.004977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b765b499-6ef4-456c-8e26-538fc451b25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831a049ab50442b78280e1bd096f97f6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.026864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1050/2110] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:44 2022] DELETE /identity/v3/users/831a049ab50442b78280e1bd096f97f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:45.325146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.326787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:45.346002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a57920-1702-4bbc-aacb-42c26343acb9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.370284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:45.416939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.417817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.418101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.418375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] PATH_INFO: `/v3/projects/f524a40b9d64430d95012f4b74867286` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.419593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f524a40b9d64430d95012f4b74867286)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.421532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.469474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f524a40b9d64430d95012f4b74867286', 'request_id': 'req-954752ae-f77d-4419-a0f9-13a3fc28c95c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.475774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f524a40b9d64430d95012f4b74867286', 'request_id': 'req-954752ae-f77d-4419-a0f9-13a3fc28c95c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.482145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f524a40b9d64430d95012f4b74867286', 'request_id': 'req-954752ae-f77d-4419-a0f9-13a3fc28c95c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.496473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] The token cache is being invalidate because project f524a40b9d64430d95012f4b74867286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:45.496757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.497408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-954752ae-f77d-4419-a0f9-13a3fc28c95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:45.498976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1061/2111] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:45 2022] DELETE /identity/v3/projects/f524a40b9d64430d95012f4b74867286 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:45.505092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.505572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.505663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.524176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:45.525387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:45.598900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1051/2112] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:45.607386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.607694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.607980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.629877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:45.631123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:45.640602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1062/2113] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:18:45.645359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.655660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95754f5-c3c6-425b-98be-5060cc6b277b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.661138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.661792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.662072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.662342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.663072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:45.663406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.665028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.674078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:45.677719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1052/2114] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:45.682760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.692943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a72144-c415-4e61-93e5-2c72866cba31 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.698281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.698961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.699279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.699572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.700262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.702421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.735847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1063/2115] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:45 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:45.736953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.747124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d757405-ea29-4952-8703-4cc1f3f37b4c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.808668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.809347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.809632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.809946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.810588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.812575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.836246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1053/2116] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:45 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:45.840188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.850775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a2e13-08f5-4a28-96ea-9d44885f1f4a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.856727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.857439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.857724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.858004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.858792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.860465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.872506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1064/2117] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:45.876704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.887147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d8d68-5bbe-4f30-b10d-2d860851b745 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.891654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a4e46-8a7d-4f48-814c-91f5ca7a22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.892322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a4e46-8a7d-4f48-814c-91f5ca7a22c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.892627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a4e46-8a7d-4f48-814c-91f5ca7a22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.892898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a4e46-8a7d-4f48-814c-91f5ca7a22c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.893639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a4e46-8a7d-4f48-814c-91f5ca7a22c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.895266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a4e46-8a7d-4f48-814c-91f5ca7a22c7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.905621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1054/2118] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:18:45.910396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:45.921382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46ab4-8b7c-4f9c-bb40-845d9bde24cf admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:45.926420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:45.927355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.927638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.927913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] PATH_INFO: `/v3/projects/4d418424f3c54a8d83f127c7104a54d0/users/f4398b0f5ec24bd3a8cc82a1266851f9/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:45.943905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d418424f3c54a8d83f127c7104a54d0, user_id=f4398b0f5ec24bd3a8cc82a1266851f9, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:45.946653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:45.963357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1065/2119] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:45 2022] PUT /identity/v3/projects/4d418424f3c54a8d83f127c7104a54d0/users/f4398b0f5ec24bd3a8cc82a1266851f9/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:45.975977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:45.976294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:45.976571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.004973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] MFA Rules not processed for user `f4398b0f5ec24bd3a8cc82a1266851f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:46.006171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:46.078199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1055/2120] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:46.082845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.136713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:46.149641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e1259-0bce-41d7-a7f6-9a1dc35f50be admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.154944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.155639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.155920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.156195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.156885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.158877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.187639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1066/2121] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:46 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:46.191989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.203255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03e1df-cd68-4ea3-91b1-786e0d9f5018 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.275737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.276413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.276688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.276957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.277659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.279638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.295973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:46.305250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1056/2122] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:46 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:46.310308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.321717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6ad48-7df1-4bd0-9993-7aaa6e09fcf1 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.326807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.327520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.327805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.328067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.328788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.330575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.342245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1067/2123] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:46.346347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.356643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe67f0-0836-4430-815c-4eda4fff661b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.361511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.362415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.362697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.362974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] PATH_INFO: `/v3/projects/bf2b4fe8d7a849ae918b579041ce9e13/users/5638e7673447476b8c3cbd9206c3902b/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.381512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2b4fe8d7a849ae918b579041ce9e13, user_id=5638e7673447476b8c3cbd9206c3902b, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.384298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.399476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1057/2124] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:46 2022] PUT /identity/v3/projects/bf2b4fe8d7a849ae918b579041ce9e13/users/5638e7673447476b8c3cbd9206c3902b/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:46.403493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.413641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eefcbf-b1c5-44ee-9796-04948a12d2bc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.473403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c6c9-9590-4621-87f1-897f2060f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.474082 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c6c9-9590-4621-87f1-897f2060f6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.474358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c6c9-9590-4621-87f1-897f2060f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.474630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c6c9-9590-4621-87f1-897f2060f6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.475391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c6c9-9590-4621-87f1-897f2060f6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.477021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c6c9-9590-4621-87f1-897f2060f6f6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.487406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1068/2125] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:46.493293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.503841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be10db-cc6d-47db-ae73-50cf14bf79b1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.509185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.510732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.511293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.511761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] PATH_INFO: `/v3/projects/bf2b4fe8d7a849ae918b579041ce9e13/users/5638e7673447476b8c3cbd9206c3902b/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.514814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2b4fe8d7a849ae918b579041ce9e13, user_id=5638e7673447476b8c3cbd9206c3902b, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.517576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.528484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1058/2126] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:46 2022] PUT /identity/v3/projects/bf2b4fe8d7a849ae918b579041ce9e13/users/5638e7673447476b8c3cbd9206c3902b/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:46.538832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.539071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.539403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.569177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] MFA Rules not processed for user `5638e7673447476b8c3cbd9206c3902b`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:46.570600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:46.643109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1069/2127] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:46.654852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.656651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:46.718542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd68397-acac-43f4-bdd0-7b8863f880be admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.722298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.722942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.723252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.723525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.733190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.734624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.744904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1059/2128] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:46.797809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:46.799447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:46.812552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9b22-dc24-489b-afec-5d72ce683598 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:46.817824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaefbc-afd9-4d7f-b0b8-860827350b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:46.818500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaefbc-afd9-4d7f-b0b8-860827350b8d service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:46.818807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaefbc-afd9-4d7f-b0b8-860827350b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:46.819086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaefbc-afd9-4d7f-b0b8-860827350b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:46.873995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:46.893380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaefbc-afd9-4d7f-b0b8-860827350b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:46.894454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eaefbc-afd9-4d7f-b0b8-860827350b8d service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:46.904830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1070/2129] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:50.293558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:50.359908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f26d8f-188b-4ad5-92b7-b285350eb348 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:50.364983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:50.366468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:50.366989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:50.367523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] PATH_INFO: `/v3/users/f4398b0f5ec24bd3a8cc82a1266851f9` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:50.371685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4398b0f5ec24bd3a8cc82a1266851f9)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:50.372061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:50.437971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4398b0f5ec24bd3a8cc82a1266851f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:50.446906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4398b0f5ec24bd3a8cc82a1266851f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:50.447817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4398b0f5ec24bd3a8cc82a1266851f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:50.448612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4398b0f5ec24bd3a8cc82a1266851f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:50.461381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:50.472138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4398b0f5ec24bd3a8cc82a1266851f9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:50.489890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1060/2130] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:50 2022] DELETE /identity/v3/users/f4398b0f5ec24bd3a8cc82a1266851f9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:50.494616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:50.495121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:50.495235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:50.514653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:50.515935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:50.582996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1071/2131] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:50.594410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:50.595892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:50.659241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359497d2-c8d6-47e6-9b49-0737f9a0fecd admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:50.663117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:50.663835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:50.664125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:50.664398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:50.674709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:50.676227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:50.685881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1061/2132] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:50.992389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:50.994372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:51.007202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895397d-02b4-4da2-831b-373ba9363ede None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:51.016732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:51.017846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:51.017987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:51.018204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] PATH_INFO: `/v3/projects/4d418424f3c54a8d83f127c7104a54d0` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:51.019588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d418424f3c54a8d83f127c7104a54d0)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:51.021681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:51.085942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d418424f3c54a8d83f127c7104a54d0', 'request_id': 'req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.093191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d418424f3c54a8d83f127c7104a54d0', 'request_id': 'req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.099022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d418424f3c54a8d83f127c7104a54d0', 'request_id': 'req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.118065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] The token cache is being invalidate because project 4d418424f3c54a8d83f127c7104a54d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:51.118373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.119052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.123236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1072/2133] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:50 2022] DELETE /identity/v3/projects/4d418424f3c54a8d83f127c7104a54d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:51.125354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:51.138007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d380f-1588-4ad7-99bf-ba70ad9abe46 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:51.221996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:51.222817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:51.223092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:51.223428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] PATH_INFO: `/v3/users/5638e7673447476b8c3cbd9206c3902b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:51.224731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5638e7673447476b8c3cbd9206c3902b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:51.226858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:51.276416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5638e7673447476b8c3cbd9206c3902b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.284524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5638e7673447476b8c3cbd9206c3902b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.285653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5638e7673447476b8c3cbd9206c3902b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.285783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5638e7673447476b8c3cbd9206c3902b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.298482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9777cd73-4145-41f4-bc13-2cf955907e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5638e7673447476b8c3cbd9206c3902b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.310741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1062/2134] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:18:51 2022] DELETE /identity/v3/users/5638e7673447476b8c3cbd9206c3902b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:51.601582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:51.603543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:51.625520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2fbfa-4bb9-4154-9b5d-745482d214b5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:51.704842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:51.705813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:51.706111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:51.706416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] PATH_INFO: `/v3/projects/bf2b4fe8d7a849ae918b579041ce9e13` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:51.707784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2b4fe8d7a849ae918b579041ce9e13)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:51.709979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:51.722018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:51.765865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2b4fe8d7a849ae918b579041ce9e13', 'request_id': 'req-97d047a6-b65a-4f58-a869-ea39f7f82e12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.775492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2b4fe8d7a849ae918b579041ce9e13', 'request_id': 'req-97d047a6-b65a-4f58-a869-ea39f7f82e12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.782734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2b4fe8d7a849ae918b579041ce9e13', 'request_id': 'req-97d047a6-b65a-4f58-a869-ea39f7f82e12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.797895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] The token cache is being invalidate because project bf2b4fe8d7a849ae918b579041ce9e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:18:51.798203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.798812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-97d047a6-b65a-4f58-a869-ea39f7f82e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:18:51.800415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1073/2135] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:18:51 2022] DELETE /identity/v3/projects/bf2b4fe8d7a849ae918b579041ce9e13 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:51.807922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:51.808218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:51.808488 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:51.816003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:51.830949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:51.832700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:51.906082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1063/2136] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:51.915815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:51.916934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:51.917217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:51.937798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:51.939069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:51.949065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1074/2137] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:51.953676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:51.963743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1085d1-a261-4c91-850e-eb0aea5bc6a6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:51.969464 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:51.970192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:51.970477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:51.970861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:51.971833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:18:51.972162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:51.973860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:51.986917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1064/2138] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:18:51.991638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:52.000895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28e584-5919-45d1-a770-2b830b6e36bc None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:52.006028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:52.006876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.007086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.007450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.008136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:52.010165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:52.038043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1075/2139] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:51 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:52.042676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:52.053377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17ad5f-c02d-4409-8925-ca168de30b53 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:52.111451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:52.112127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.112410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.112684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.113384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:52.115401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:52.142476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1065/2140] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:52 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:52.147248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:52.158273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16adf3-94b1-4ebe-9f40-8c03d58654b8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:52.164229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:52.164912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.165190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.165457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.166552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:52.168246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:52.180582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1076/2141] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:52.184789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:52.195315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4149cca-e02d-4f6c-acc7-15cb3997cdee admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:52.200102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07eabb-79bd-45eb-9d5d-2ebf9c40c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:52.200781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07eabb-79bd-45eb-9d5d-2ebf9c40c308 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.201064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07eabb-79bd-45eb-9d5d-2ebf9c40c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.201337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07eabb-79bd-45eb-9d5d-2ebf9c40c308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.202098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07eabb-79bd-45eb-9d5d-2ebf9c40c308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:52.203788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07eabb-79bd-45eb-9d5d-2ebf9c40c308 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:52.214507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1066/2142] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:52.218934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:52.228957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab30786-45ff-4c7c-9244-5d54fb22c61a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:52.233992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:52.235202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.235489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.235781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] PATH_INFO: `/v3/projects/711b13e4ea3e4269a0082811f6708d87/users/e40faab6a34f4d368462cdcafb7bcfea/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.254139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711b13e4ea3e4269a0082811f6708d87, user_id=e40faab6a34f4d368462cdcafb7bcfea, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:52.257148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:52.280100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1077/2143] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:52 2022] PUT /identity/v3/projects/711b13e4ea3e4269a0082811f6708d87/users/e40faab6a34f4d368462cdcafb7bcfea/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:18:52.285526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0acfa-57d8-4ee7-a5e8-7050ba4b9d54 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.285993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0acfa-57d8-4ee7-a5e8-7050ba4b9d54 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.286340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0acfa-57d8-4ee7-a5e8-7050ba4b9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.308008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d9c0acfa-57d8-4ee7-a5e8-7050ba4b9d54 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:52.309553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d9c0acfa-57d8-4ee7-a5e8-7050ba4b9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:52.373299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1067/2144] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:52.383652 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:52.385545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:52.451015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186c15e-0116-497e-8b68-006be9f59c45 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:52.455593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:52.456303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:52.456580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:52.456837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:52.466716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:52.468373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:52.478643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1078/2145] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:18:57.517076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:57.517557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:57.517661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:57.555016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:57.569452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] MFA Rules not processed for user `e40faab6a34f4d368462cdcafb7bcfea`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:18:57.571182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:18:57.686394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1068/2146] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:18:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:18:57.691068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:57.703058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2926a-5b81-40a9-97ba-8de7377fc34e service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:57.713724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:57.714660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:57.715127 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:57.715647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:57.716533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:57.719013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:57.752010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1079/2147] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:18:57 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:18:57.756378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:57.772302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4f473-6ed9-4ed6-a6ee-45e8e2e38648 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:57.863027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:57.864117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:57.865861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:57.866521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:57.867625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:57.870004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:57.911238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1069/2148] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:18:57 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:18:57.914294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:57.925462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c86e63-a0e7-4193-b285-0b0a0e7315aa admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:57.930507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:57.931420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:57.931536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:57.931758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:57.932907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:57.934173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:57.950680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1080/2149] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:57.951452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:57.963529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f3613-67e2-44c2-8b80-4f00bd7c7c8e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:57.971591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:57.972708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:57.973029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:57.973554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] PATH_INFO: `/v3/projects/6d43c614a2384feca5c79f81fb7515a3/users/3044aa4a7efc4915b26102bde7a6c582/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:57.991072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d43c614a2384feca5c79f81fb7515a3, user_id=3044aa4a7efc4915b26102bde7a6c582, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:57.995387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:58.018111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1070/2150] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:57 2022] PUT /identity/v3/projects/6d43c614a2384feca5c79f81fb7515a3/users/3044aa4a7efc4915b26102bde7a6c582/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:18:58.019986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:58.030121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:18:58.035487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fcf48-ec77-4395-886b-c7125952612b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:58.126485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bec8c4-0ccb-41ed-a8b6-d499fae038cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:58.127449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bec8c4-0ccb-41ed-a8b6-d499fae038cb admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:58.127693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bec8c4-0ccb-41ed-a8b6-d499fae038cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:58.128032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bec8c4-0ccb-41ed-a8b6-d499fae038cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:58.128832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bec8c4-0ccb-41ed-a8b6-d499fae038cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:58.130568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bec8c4-0ccb-41ed-a8b6-d499fae038cb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:58.141678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1081/2151] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:18:58.146227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:18:58.160723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63c2c9-b354-4728-9075-6b407fc97d27 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:18:58.166687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:18:58.167895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:18:58.168177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:18:58.168446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] PATH_INFO: `/v3/projects/6d43c614a2384feca5c79f81fb7515a3/users/3044aa4a7efc4915b26102bde7a6c582/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:18:58.170801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d43c614a2384feca5c79f81fb7515a3, user_id=3044aa4a7efc4915b26102bde7a6c582, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:18:58.173637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:18:58.185983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1071/2152] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:18:58 2022] PUT /identity/v3/projects/6d43c614a2384feca5c79f81fb7515a3/users/3044aa4a7efc4915b26102bde7a6c582/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:03.264270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeca32a-2983-42f7-8a04-1b6c57508128 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:03.264759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeca32a-2983-42f7-8a04-1b6c57508128 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:03.264851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeca32a-2983-42f7-8a04-1b6c57508128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:03.294930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-cdeca32a-2983-42f7-8a04-1b6c57508128 None None] MFA Rules not processed for user `3044aa4a7efc4915b26102bde7a6c582`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:03.296298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cdeca32a-2983-42f7-8a04-1b6c57508128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:03.389270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1082/2153] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:03.398837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:03.400761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:03.487939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf517a-3e7e-4b2e-8a5c-f5e5333f01ac admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:03.491885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:03.492555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:03.492980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:03.493267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:03.499939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:03.563944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:03.565677 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:03.580621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1072/2154] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:03.796300 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b3d63-6e54-4555-984b-3d2bb976af0d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:03.796625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b3d63-6e54-4555-984b-3d2bb976af0d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:03.797481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b3d63-6e54-4555-984b-3d2bb976af0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:03.829384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6f7b3d63-6e54-4555-984b-3d2bb976af0d None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:03.833550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6f7b3d63-6e54-4555-984b-3d2bb976af0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:03.923035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1083/2155] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:19:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:03.975511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:03.977151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:04.117890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8243cd-af71-4d41-8558-0589dfc20e98 service glance] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:04.125959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:04.126699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:04.132700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:04.132700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:04.138909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:04.140919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:04.159757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1073/2156] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:19:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:19:05.678691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a073df-9f1d-451b-a067-fc61e0383e09 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:05.679371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a073df-9f1d-451b-a067-fc61e0383e09 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:05.679371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a073df-9f1d-451b-a067-fc61e0383e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:05.711504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-48a073df-9f1d-451b-a067-fc61e0383e09 None None] MFA Rules not processed for user `7da83fc4029c4cdebca07c7247669bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:05.718041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-48a073df-9f1d-451b-a067-fc61e0383e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:05.758885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:05.811200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1084/2157] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:09.210321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:09.212407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:09.459532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:09.596420 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4619603-3a95-4210-9ccd-9fc59a617a0f service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:09.612775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:09.613965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:09.614370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:09.614770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] PATH_INFO: `/v3/users/7f6426984eb846788f60a73b264d0c46` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:09.616724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6426984eb846788f60a73b264d0c46)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:09.624817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:09.762529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6426984eb846788f60a73b264d0c46'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:09.800840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6426984eb846788f60a73b264d0c46'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:09.801611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6426984eb846788f60a73b264d0c46'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:09.802696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6426984eb846788f60a73b264d0c46'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:09.829508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6426984eb846788f60a73b264d0c46'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:09.887235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1074/2158] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:19:09 2022] DELETE /identity/v3/users/7f6426984eb846788f60a73b264d0c46 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:09.892903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:09.893888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:09.894368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:09.957885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:09.959408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:10.051102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1085/2159] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:10.071716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:10.078514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:10.224692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107dced-dd3d-4e1d-9441-cfc06e5802ac admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:10.228843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be5d77-03bd-4d35-a303-0b7cc272473f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:10.229575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be5d77-03bd-4d35-a303-0b7cc272473f service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:10.229975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be5d77-03bd-4d35-a303-0b7cc272473f service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:10.230306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be5d77-03bd-4d35-a303-0b7cc272473f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:10.251588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be5d77-03bd-4d35-a303-0b7cc272473f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:10.253154 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be5d77-03bd-4d35-a303-0b7cc272473f service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:10.270087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1075/2160] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:10.773410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:10.774937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:10.808926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d7e7-d48e-4728-a849-3b25f0c1cffa None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:10.818995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:10.821276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:10.822131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:10.822869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] PATH_INFO: `/v3/projects/0698123ada9a460d9d1863d3e6174ad6` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:10.825981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0698123ada9a460d9d1863d3e6174ad6)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:10.830042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:10.977654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0698123ada9a460d9d1863d3e6174ad6', 'request_id': 'req-c12f7632-7062-4a7c-8a74-67878f4e6c08'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:11.017818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0698123ada9a460d9d1863d3e6174ad6', 'request_id': 'req-c12f7632-7062-4a7c-8a74-67878f4e6c08'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:11.049247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0698123ada9a460d9d1863d3e6174ad6', 'request_id': 'req-c12f7632-7062-4a7c-8a74-67878f4e6c08'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:11.108749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] The token cache is being invalidate because project 0698123ada9a460d9d1863d3e6174ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:19:11.109738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:11.111145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c12f7632-7062-4a7c-8a74-67878f4e6c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:11.114183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1086/2161] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:19:10 2022] DELETE /identity/v3/projects/0698123ada9a460d9d1863d3e6174ad6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:11.119736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.120232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.120668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.184098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:11.190598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:11.192776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:11.294360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1076/2162] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:19:11.304566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.304915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.305291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.326286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:11.328367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:11.336938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1087/2163] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:19:11.343440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.354519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a835dc2-bca6-437d-92cf-7211b5bb5d9f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.359699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.360671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.361120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.361529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.362415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:19:11.362876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.364714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.379728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1077/2164] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:19:11.383937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.393780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f3b2c-df7b-45cc-a40d-2def6b6d355f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.401462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.402708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.402708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.402708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.403699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.405764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.437824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1088/2165] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:19:11 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:19:11.442138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.453235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469725b0-1266-48e1-bf16-fbd10eed5c1e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.530411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.531244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.531594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.531938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.532749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.534911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.561970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1078/2166] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:19:11 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:19:11.565949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.577032 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b84fc-7b0a-4421-8088-962cb1d51e2b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.581914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.582980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.583295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.583753 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.584794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.586427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.607307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1089/2167] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:19:11.608826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.621107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad17964-6ced-4b3b-b4bc-6ab5747aedbb admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.626212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdfed7-aede-46be-a56b-805249ee6c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.626888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfed7-aede-46be-a56b-805249ee6c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.627189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfed7-aede-46be-a56b-805249ee6c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.627496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdfed7-aede-46be-a56b-805249ee6c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.628385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdfed7-aede-46be-a56b-805249ee6c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.630236 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdfed7-aede-46be-a56b-805249ee6c9c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.643759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1079/2168] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:19:11.648225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.660680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bde6b-e32c-44ab-892b-d8c5eb1ac2e3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.665577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.667549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.667549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.669185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] PATH_INFO: `/v3/projects/6470bb0891264a89bb9bcc9187fb9d04/users/6f018c4f5f3641c18731a97a0e4c0462/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.680637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:11.688325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6470bb0891264a89bb9bcc9187fb9d04, user_id=6f018c4f5f3641c18731a97a0e4c0462, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.691278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.710048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1090/2169] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:19:11 2022] PUT /identity/v3/projects/6470bb0891264a89bb9bcc9187fb9d04/users/6f018c4f5f3641c18731a97a0e4c0462/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:19:11.720921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8884-2229-43d9-8dff-641c176a9d87 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.720921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8884-2229-43d9-8dff-641c176a9d87 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.721221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8884-2229-43d9-8dff-641c176a9d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.753295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3bee8884-2229-43d9-8dff-641c176a9d87 None None] MFA Rules not processed for user `6f018c4f5f3641c18731a97a0e4c0462`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:11.754691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3bee8884-2229-43d9-8dff-641c176a9d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:11.830547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1080/2170] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:11.841754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:11.843618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:11.918019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913b600-c723-4586-b22c-dad23b69df4e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:11.924602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:11.925406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:11.925954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:11.926380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:11.937304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:11.938965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:11.963586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1091/2171] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:15.051477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21ca02-e352-4a13-8e6a-7c8819b6a5ba None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:15.052099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21ca02-e352-4a13-8e6a-7c8819b6a5ba None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:15.053466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21ca02-e352-4a13-8e6a-7c8819b6a5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:15.061375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:15.097347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5d21ca02-e352-4a13-8e6a-7c8819b6a5ba None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:15.098947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5d21ca02-e352-4a13-8e6a-7c8819b6a5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:15.281081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1081/2172] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:15.315235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:15.317489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:15.480919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8aeb2-9b23-49b0-920f-e6890d6c7db1 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:15.486842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653cb6d-c62e-4fe3-8e97-2a9e57cb0f48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:15.487711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb6d-c62e-4fe3-8e97-2a9e57cb0f48 service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:15.488208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb6d-c62e-4fe3-8e97-2a9e57cb0f48 service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:15.488706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653cb6d-c62e-4fe3-8e97-2a9e57cb0f48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:15.499675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cb6d-c62e-4fe3-8e97-2a9e57cb0f48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:15.501807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653cb6d-c62e-4fe3-8e97-2a9e57cb0f48 service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:15.513354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1092/2173] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:19:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:19:18.505673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:18.506303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:18.506303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:18.533805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] MFA Rules not processed for user `e40faab6a34f4d368462cdcafb7bcfea`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:18.535106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:18.644040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1082/2174] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:25.343236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:25.344483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:25.345028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:25.419952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:25.423096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:25.438491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1093/2175] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:25.450181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:25.477517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:25.496410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebd95e-e5e1-40d4-b852-f876bbb47dc5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:25.517104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35fbe-9449-4251-be91-f94e409ff872 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:25.518219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35fbe-9449-4251-be91-f94e409ff872 service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:25.518707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35fbe-9449-4251-be91-f94e409ff872 service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:25.518990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35fbe-9449-4251-be91-f94e409ff872 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:25.536551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35fbe-9449-4251-be91-f94e409ff872 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:25.543085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35fbe-9449-4251-be91-f94e409ff872 service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:25.555389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1094/2176] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:19:25.640600 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf382c-58f8-4662-a226-2073a5b81ef9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:25.650159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:25.651403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:25.651829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:25.652281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] PATH_INFO: `/v3/users/6f018c4f5f3641c18731a97a0e4c0462` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:25.654184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f018c4f5f3641c18731a97a0e4c0462)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:25.657601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:25.738953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f018c4f5f3641c18731a97a0e4c0462'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:25.753982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f018c4f5f3641c18731a97a0e4c0462'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:25.755248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f018c4f5f3641c18731a97a0e4c0462'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:25.756381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f018c4f5f3641c18731a97a0e4c0462'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:25.758762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:25.782987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f018c4f5f3641c18731a97a0e4c0462'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:25.818896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1083/2177] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:19:25 2022] DELETE /identity/v3/users/6f018c4f5f3641c18731a97a0e4c0462 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:25.820550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:25.822373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:25.822744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:25.867285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:25.870688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:25.993642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:26.015035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1095/2178] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:26.026686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:26.028684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:26.190441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b4726-4801-4563-89f1-631486292909 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:26.196085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c8060-66d8-4379-a0e9-be9940639c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:26.196879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c8060-66d8-4379-a0e9-be9940639c1a service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:26.199525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c8060-66d8-4379-a0e9-be9940639c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:26.199835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c8060-66d8-4379-a0e9-be9940639c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:26.228717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c8060-66d8-4379-a0e9-be9940639c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:26.229767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c8060-66d8-4379-a0e9-be9940639c1a service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:26.247648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1084/2179] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:27.364643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:27.366623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:27.389028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b182de-8ffa-44c4-af01-6a5ceea49dfc None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:27.399088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:27.400103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:27.400341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:27.400620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] PATH_INFO: `/v3/projects/6470bb0891264a89bb9bcc9187fb9d04` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:27.410107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6470bb0891264a89bb9bcc9187fb9d04)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:27.412081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:27.567308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6470bb0891264a89bb9bcc9187fb9d04', 'request_id': 'req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:27.595108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6470bb0891264a89bb9bcc9187fb9d04', 'request_id': 'req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:27.617284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6470bb0891264a89bb9bcc9187fb9d04', 'request_id': 'req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:27.669142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] The token cache is being invalidate because project 6470bb0891264a89bb9bcc9187fb9d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:19:27.670206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:27.672000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4e0825e1-1c85-42f3-8a8b-a07d28566ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:27.684933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1096/2180] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:19:27 2022] DELETE /identity/v3/projects/6470bb0891264a89bb9bcc9187fb9d04 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:27.688640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:27.689241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:27.689241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:27.795711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:27.799331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:27.988958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1085/2181] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:19:27.997958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:27.999434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:27.999962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.044126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:28.049489 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:28.077688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1097/2182] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:28.083125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:28.095957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac6bc-1869-4c9a-af85-1166e55aa372 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:28.101922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:28.103272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.103750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.104111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.113670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:19:28.113670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:28.113670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:28.121447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1086/2183] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:19:28.126414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:28.141460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0089b-fe4e-424f-84e7-e384fc5e7271 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:28.157922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:28.158789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.159384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.159751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.160611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:28.170902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:28.227948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1098/2184] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:19:28 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:19:28.232804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:28.253579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f73ad-d25c-442c-b72f-67200597ca32 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:28.397059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:28.427199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:28.432303 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.435376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.435833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.437596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:28.446914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:28.495560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:28.506840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1087/2185] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:19:28 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:19:28.514409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85652d5c-48a5-4742-8f32-85509f72693a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:28.538519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:28.539859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.540330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.542018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.542766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:28.550307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:28.602463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:28.610552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1099/2186] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:19:28.616973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71166aac-4e89-4239-9db2-742ab9c4654e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:28.644571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec5ced-2739-4578-9380-b300cc5f3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:28.645400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5ced-2739-4578-9380-b300cc5f3789 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.645668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5ced-2739-4578-9380-b300cc5f3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.645992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec5ced-2739-4578-9380-b300cc5f3789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.646742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5ced-2739-4578-9380-b300cc5f3789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:28.658234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec5ced-2739-4578-9380-b300cc5f3789 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:28.699086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1088/2187] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:19:28.703669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:28.720757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b4ee8-251d-4e50-a807-492b83e685c7 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:28.754051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:28.755302 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.761262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.761852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] PATH_INFO: `/v3/projects/073368e447af465abb41aa556ee46dc9/users/b53b45a485b14e0b9273c019dc9ec206/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.809218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] RBAC: Authorizing `identity:create_grant(project_id=073368e447af465abb41aa556ee46dc9, user_id=b53b45a485b14e0b9273c019dc9ec206, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:28.813214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:28.846015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e00254-5eb8-443a-99c3-d2d79e089406 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:28.846592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e00254-5eb8-443a-99c3-d2d79e089406 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:28.847045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e00254-5eb8-443a-99c3-d2d79e089406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:28.848749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1100/2188] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:19:28 2022] PUT /identity/v3/projects/073368e447af465abb41aa556ee46dc9/users/b53b45a485b14e0b9273c019dc9ec206/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:28.869952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-35e00254-5eb8-443a-99c3-d2d79e089406 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:28.872278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-35e00254-5eb8-443a-99c3-d2d79e089406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:29.028187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1089/2189] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:29.074012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:29.081847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:29.254517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eba69-2f55-401c-ad54-49087519278e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:29.262566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259e403-0fd7-43b3-8bb6-58e6d5956e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:29.264946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e403-0fd7-43b3-8bb6-58e6d5956e25 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:29.265488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e403-0fd7-43b3-8bb6-58e6d5956e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:29.266324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259e403-0fd7-43b3-8bb6-58e6d5956e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:29.315270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e403-0fd7-43b3-8bb6-58e6d5956e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:29.317173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259e403-0fd7-43b3-8bb6-58e6d5956e25 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:29.359960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1101/2190] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:30.446697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:30.446697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:30.446697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:30.472442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] MFA Rules not processed for user `a0c9f3f10fd142439521e4b36cf33157`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:30.474089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:30.554666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1090/2191] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:31.219909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90610-7095-455a-8d32-cfd491c3eaf5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:31.220523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90610-7095-455a-8d32-cfd491c3eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:31.220523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee90610-7095-455a-8d32-cfd491c3eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:31.273158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-fee90610-7095-455a-8d32-cfd491c3eaf5 None None] MFA Rules not processed for user `b53b45a485b14e0b9273c019dc9ec206`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:31.274560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-fee90610-7095-455a-8d32-cfd491c3eaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:31.286894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:31.503979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1102/2192] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:31.516829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:31.522094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:31.680648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6cc71-8066-4e44-b165-5eaf2c96211a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:31.691898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e54785-b435-4638-8b64-2a9b6a106102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:31.693004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54785-b435-4638-8b64-2a9b6a106102 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:31.695193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54785-b435-4638-8b64-2a9b6a106102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:31.695534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e54785-b435-4638-8b64-2a9b6a106102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:31.718964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e54785-b435-4638-8b64-2a9b6a106102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:31.723302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e54785-b435-4638-8b64-2a9b6a106102 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:31.745896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1091/2193] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:33.418725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:33.419209 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:33.419513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:33.472376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] MFA Rules not processed for user `b53b45a485b14e0b9273c019dc9ec206`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:33.473912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:33.494858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1103/2194] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:38.258575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a849f4-d9d9-4c5c-952e-930275446eb2 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:38.259127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a849f4-d9d9-4c5c-952e-930275446eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:38.259127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a849f4-d9d9-4c5c-952e-930275446eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:38.283365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a4a849f4-d9d9-4c5c-952e-930275446eb2 None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:38.284571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a4a849f4-d9d9-4c5c-952e-930275446eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:38.301497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:38.421285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1092/2195] 10.222.0.45 () {58 vars in 967 bytes} [Wed May 25 16:19:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:38.436556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:38.438951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:38.574158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d32c6-1301-47e8-a78e-8624f97a946c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:38.601343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:38.602386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:38.602772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:38.603185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:38.616335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:38.619050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:38.644668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1104/2196] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:19:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 16:19:39.857624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:39.858203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:39.858470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:39.882798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] MFA Rules not processed for user `829c30cd914f48548b987bd6e39ee774`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:39.884635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:39.979809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1093/2197] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:40.846706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:40.848830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:40.866062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af95f4-8cab-4574-aa45-969681698994 service swift] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:40.871374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:40.872754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:40.873304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:40.873598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] PATH_INFO: `/v3/users/63c237a15880463d9b3850dac6413ceb` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:40.875504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c237a15880463d9b3850dac6413ceb)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:40.879109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:40.935510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c237a15880463d9b3850dac6413ceb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:40.936363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c237a15880463d9b3850dac6413ceb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:40.937979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c237a15880463d9b3850dac6413ceb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:40.958675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c237a15880463d9b3850dac6413ceb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:40.977628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5cac5023-2209-4e5d-9ce1-7d1d87da5717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c237a15880463d9b3850dac6413ceb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:40.990599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:40.996556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1105/2198] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:19:40 2022] DELETE /identity/v3/users/63c237a15880463d9b3850dac6413ceb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:19:41.231662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.250518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf051-f039-4c14-87a2-d2f3847696db None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.368771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.369702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.369989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.370370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] PATH_INFO: `/v3/projects/2aca09e1a3bc4926ba6c14f975728e39` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.371478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aca09e1a3bc4926ba6c14f975728e39)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:41.374573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:41.432211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aca09e1a3bc4926ba6c14f975728e39', 'request_id': 'req-585ebf03-efcd-431f-9a7a-78966d1fd6c8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:41.439431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aca09e1a3bc4926ba6c14f975728e39', 'request_id': 'req-585ebf03-efcd-431f-9a7a-78966d1fd6c8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:41.446592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aca09e1a3bc4926ba6c14f975728e39', 'request_id': 'req-585ebf03-efcd-431f-9a7a-78966d1fd6c8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:41.456147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:41.472093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] The token cache is being invalidate because project 2aca09e1a3bc4926ba6c14f975728e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:19:41.472943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:41.473923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-585ebf03-efcd-431f-9a7a-78966d1fd6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:41.475748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1094/2199] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:19:41 2022] DELETE /identity/v3/projects/2aca09e1a3bc4926ba6c14f975728e39 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:41.483291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.483967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.484426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.507724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:41.509002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:41.598173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1106/2200] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:41.606261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.606547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.607074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.636789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:41.639899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:41.650706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1095/2201] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:41.655557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.666549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ab03f-460e-4a2b-95c8-273ba56654f2 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.672577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.673264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.673555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.673827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.674566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:19:41.674875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:41.676580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:41.691961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1107/2202] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:19:41.696888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.707853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065b66b-a1ba-4de2-9e3d-0efcbb8e8ad3 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.714916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.715771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.716082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.716570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.717614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:41.720799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:41.757044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1096/2203] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:19:41 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:19:41.759204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.771708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468929e-de8f-42b1-b5bb-f825a143e1b8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.848551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.850139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.850587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.851045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.852188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:41.854210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:41.884818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1108/2204] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:19:41 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:19:41.889321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.904042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96f2c0-de1d-4746-b798-3309528cfe5c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.909427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.910200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.910605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.910968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.911873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:41.913617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:41.926651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1097/2205] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:19:41.930549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.942159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fa25d-bca1-4c82-81b6-8130a657a52c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.948463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0a4a-f325-4aab-959e-9380d265b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.949613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0a4a-f325-4aab-959e-9380d265b424 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.949890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0a4a-f325-4aab-959e-9380d265b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.950174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0a4a-f325-4aab-959e-9380d265b424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:41.950985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0a4a-f325-4aab-959e-9380d265b424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:41.952663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0a4a-f325-4aab-959e-9380d265b424 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:41.970207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1109/2206] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:19:41.971384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:41.982163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d3715-4212-463b-9496-6cc43f5100f8 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:41.987933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:41.989363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:41.989870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:41.990356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] PATH_INFO: `/v3/projects/a01f099b613347ce86f9b99d433f9d86/users/83f24e01f23348eb9cd3c7aa1cdfccd3/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:42.014191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01f099b613347ce86f9b99d433f9d86, user_id=83f24e01f23348eb9cd3c7aa1cdfccd3, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:42.017339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:42.033710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1098/2207] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:19:41 2022] PUT /identity/v3/projects/a01f099b613347ce86f9b99d433f9d86/users/83f24e01f23348eb9cd3c7aa1cdfccd3/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:19:42.045493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:42.045844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:42.046400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:42.085303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] MFA Rules not processed for user `83f24e01f23348eb9cd3c7aa1cdfccd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:42.086536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:42.151604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:42.163010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1110/2208] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:19:42.175793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:42.177623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:42.265873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26c1d-8b96-4750-a797-eeed319f4de6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:42.269898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:42.270678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:42.270963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:42.271270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:42.280563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:42.282069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:42.294700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1099/2209] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:42.889627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:42.891876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:42.962816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fe8a-db16-494c-aa8c-812a4871a860 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:42.966447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:42.967133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:42.967452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:42.967739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:42.969996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:43.044247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:43.045758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317324d-b088-45d6-a0e5-463ca30e9930 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:43.057039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1111/2210] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:19:49.622686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:49.758167 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2ec4-5661-4cfc-ac08-c5a03a72e716 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:49.772669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:49.777827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:49.778415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:49.778948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] PATH_INFO: `/v3/users/83f24e01f23348eb9cd3c7aa1cdfccd3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:49.783278 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f24e01f23348eb9cd3c7aa1cdfccd3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:49.786445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:49.812421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:49.837941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b270e-a803-400a-b266-bd331a5c677f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:49.838984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b270e-a803-400a-b266-bd331a5c677f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:49.839472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b270e-a803-400a-b266-bd331a5c677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:49.859719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-564b270e-a803-400a-b266-bd331a5c677f None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:49.860930 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-564b270e-a803-400a-b266-bd331a5c677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:49.861520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f24e01f23348eb9cd3c7aa1cdfccd3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:49.871882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f24e01f23348eb9cd3c7aa1cdfccd3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:49.874123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f24e01f23348eb9cd3c7aa1cdfccd3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:49.875033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f24e01f23348eb9cd3c7aa1cdfccd3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:49.911779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43194981-a11e-4033-9fd2-abb991986591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f24e01f23348eb9cd3c7aa1cdfccd3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:49.933866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1100/2211] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:19:49 2022] DELETE /identity/v3/users/83f24e01f23348eb9cd3c7aa1cdfccd3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:19:49.936060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:49.936369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:49.936653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:49.945132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1112/2212] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:19:49.960155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:19:49.961847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b270e-a803-400a-b266-bd331a5c677f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:49.963187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:49.963768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-564b270e-a803-400a-b266-bd331a5c677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:50.032694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:50.058977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1101/2213] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:19:50.059216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b270e-a803-400a-b266-bd331a5c677f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:50.070678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:50.072644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:50.164003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:50.164670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:50.165132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:50.165641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:50.166914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3d97c-b5d0-49ca-9ac1-eeebb543a576 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:50.170930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:50.171621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:50.171901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:50.172169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:50.182005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:50.183568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:50.193800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1102/2214] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:19:50.228757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:50.230665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:50.240496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1113/2215] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:19:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 16:19:50.527048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:19:50.528700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:19:50.556838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01839f4d-f4c2-423d-a9b8-60428b64447a service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:19:50.561882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:19:50.562830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:19:50.563779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:19:50.564126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] PATH_INFO: `/v3/projects/a01f099b613347ce86f9b99d433f9d86` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:19:50.565416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01f099b613347ce86f9b99d433f9d86)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:19:50.567755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:19:50.612427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:19:50.629006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01f099b613347ce86f9b99d433f9d86', 'request_id': 'req-614bc617-13fa-4584-83db-9154cf908764'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:50.636199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01f099b613347ce86f9b99d433f9d86', 'request_id': 'req-614bc617-13fa-4584-83db-9154cf908764'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:50.642259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01f099b613347ce86f9b99d433f9d86', 'request_id': 'req-614bc617-13fa-4584-83db-9154cf908764'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:50.657033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] The token cache is being invalidate because project a01f099b613347ce86f9b99d433f9d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:19:50.657398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:50.658097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-614bc617-13fa-4584-83db-9154cf908764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:19:50.688709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1103/2216] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:19:50 2022] DELETE /identity/v3/projects/a01f099b613347ce86f9b99d433f9d86 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:20:00.237101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=57 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:00.653973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:09.213368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:09.227534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0fba-e61f-413a-b51c-a0dca102dc7a service swift] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:09.293654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:09.295258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:09.295258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:09.295258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:09.297273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:09.394818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:09.397351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7580-e0e0-485f-bde7-ca76821b9aaf service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:09.409717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1114/2217] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:20:09.780532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46f8ea-17cb-4c7b-9ccb-c4dcfc977577 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:09.780990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46f8ea-17cb-4c7b-9ccb-c4dcfc977577 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:09.781164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46f8ea-17cb-4c7b-9ccb-c4dcfc977577 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:09.783141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1104/2218] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:20:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:20:09.796177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51215029-2324-4976-964f-a897ed24bb3e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:09.796572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51215029-2324-4976-964f-a897ed24bb3e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:09.797158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51215029-2324-4976-964f-a897ed24bb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:09.860335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-51215029-2324-4976-964f-a897ed24bb3e None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:20:09.861923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-51215029-2324-4976-964f-a897ed24bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:09.961574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1115/2219] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:20:09.973417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46f8ea-17cb-4c7b-9ccb-c4dcfc977577 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:09.975083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4d46f8ea-17cb-4c7b-9ccb-c4dcfc977577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:10.057415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46f8ea-17cb-4c7b-9ccb-c4dcfc977577 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:10.065718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af1292-e414-4e21-8e6c-291ef8a8040b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:10.066735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af1292-e414-4e21-8e6c-291ef8a8040b service glance] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.066735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af1292-e414-4e21-8e6c-291ef8a8040b service glance] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.066913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af1292-e414-4e21-8e6c-291ef8a8040b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.078641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af1292-e414-4e21-8e6c-291ef8a8040b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:10.080103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af1292-e414-4e21-8e6c-291ef8a8040b service glance] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:10.091857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1105/2220] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:20:10.160151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955c5f-4e9e-401f-8e69-e158019b97ba None None] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.160483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955c5f-4e9e-401f-8e69-e158019b97ba None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.160747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15955c5f-4e9e-401f-8e69-e158019b97ba None None] PATH_INFO: `/` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.162130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1116/2221] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:20:10.168089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e61bd-cc79-46f7-b7d0-c01858bfb63f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.168374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e61bd-cc79-46f7-b7d0-c01858bfb63f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.169267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e61bd-cc79-46f7-b7d0-c01858bfb63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.187823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-765e61bd-cc79-46f7-b7d0-c01858bfb63f None None] MFA Rules not processed for user `99e8bd308e5549618c66d6edaf02523c`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:20:10.189119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-765e61bd-cc79-46f7-b7d0-c01858bfb63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:10.196528 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1106/2222] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:20:10.208491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955c5f-4e9e-401f-8e69-e158019b97ba None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:10.210545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-15955c5f-4e9e-401f-8e69-e158019b97ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:10.224959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15955c5f-4e9e-401f-8e69-e158019b97ba None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:10.229595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768be6-19b7-46b2-bf4e-a0ba1f184e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:10.230325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768be6-19b7-46b2-bf4e-a0ba1f184e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.230679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768be6-19b7-46b2-bf4e-a0ba1f184e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.231025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768be6-19b7-46b2-bf4e-a0ba1f184e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.243291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:10.247001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7768be6-19b7-46b2-bf4e-a0ba1f184e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:10.248668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7768be6-19b7-46b2-bf4e-a0ba1f184e7f service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:10.261839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1117/2223] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:20:10.361173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008b71-b6cd-4e43-b738-ab18a0eebdd8 None None] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.361502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008b71-b6cd-4e43-b738-ab18a0eebdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.361791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008b71-b6cd-4e43-b738-ab18a0eebdd8 None None] PATH_INFO: `/` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.363216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1107/2224] 10.222.0.45 () {54 vars in 921 bytes} [Wed May 25 16:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:20:10.369111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.369510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.369859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.392870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] MFA Rules not processed for user `ff4b9a16037c4657bd7710297746ad4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:20:10.393737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:10.403373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1118/2225] 10.222.0.45 () {58 vars in 1018 bytes} [Wed May 25 16:20:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:20:10.414844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008b71-b6cd-4e43-b738-ab18a0eebdd8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:10.430040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008b71-b6cd-4e43-b738-ab18a0eebdd8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:10.433875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ffff4-5bb4-4d57-a565-8092b4e089c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:10.434621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffff4-5bb4-4d57-a565-8092b4e089c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:10.434898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffff4-5bb4-4d57-a565-8092b4e089c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:10.435190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ffff4-5bb4-4d57-a565-8092b4e089c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:10.446350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffff4-5bb4-4d57-a565-8092b4e089c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:10.447868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ffff4-5bb4-4d57-a565-8092b4e089c0 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:10.460128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1108/2226] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:20:10.930695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:10.932077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:11.055088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39051ec-76eb-4a20-9c81-67e3c5cf5221 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:11.061404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:11.062274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:11.062456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:11.067203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:11.071977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:11.086519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:11.088155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:11.103479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1119/2227] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:20:13.649473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b2c10-ac63-4623-9c22-f28b856ce51d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:13.650009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b2c10-ac63-4623-9c22-f28b856ce51d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:13.650009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b2c10-ac63-4623-9c22-f28b856ce51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:13.709056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-121b2c10-ac63-4623-9c22-f28b856ce51d None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:20:13.710331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-121b2c10-ac63-4623-9c22-f28b856ce51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:13.780953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1109/2228] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:20:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:20:13.804761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:13.806273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:13.921966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea691-4aaa-49d5-9eae-4d56eda43101 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:13.927532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:13.928417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:13.928882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:13.929322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:13.941291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:13.945437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:13.957987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1120/2229] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:20:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:20:23.777866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=84 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:23.952080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=87 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:20:50.352847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e27fc-e101-415b-93f1-e61a55fde79b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:50.353406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e27fc-e101-415b-93f1-e61a55fde79b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:50.353406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e27fc-e101-415b-93f1-e61a55fde79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:50.372358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a81e27fc-e101-415b-93f1-e61a55fde79b None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:20:50.373556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a81e27fc-e101-415b-93f1-e61a55fde79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:20:50.382165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1110/2230] 10.222.0.45 () {58 vars in 967 bytes} [Wed May 25 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:20:50.394840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:20:50.405810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66907796-7ddc-498f-a0c6-0a32b2b8e5aa service swift] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:20:50.411538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:20:50.412244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:20:50.412565 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:20:50.412846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:20:50.421928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:20:50.423572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:20:50.432234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1121/2231] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:21:00.367282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:00.428522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:21:09.222252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:21:09.222824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:21:09.222824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:21:09.241452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] MFA Rules not processed for user `b53b45a485b14e0b9273c019dc9ec206`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:21:09.242659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:21:09.302626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1111/2232] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:21:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:21:19.294913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=25 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:10.411582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:10.422726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e47b41-63bd-481d-958f-838df133dfc6 service swift] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:10.426589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:10.427242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:10.427560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:10.427837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:10.430051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:10.445434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:10.447319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:10.461143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1122/2233] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:15.526487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:15.537241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3972d0d-9171-4c8b-a0e5-eb00294e3c1a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:15.541448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:15.542091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:15.542375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:15.542647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:15.544652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:15.559105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:15.560669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:15.572186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1112/2234] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:20.455399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:23.475182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:23.477018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:23.491393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b76e14-8522-4501-86d1-f57c052eb4d4 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:23.498507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:23.499165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:23.499492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:23.499756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:23.501835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:23.564965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:23.566612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:23.598367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1123/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:23.699640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:23.702007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:23.723988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962afb-2d2f-48e3-b74e-24048a2a2dae service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:23.731214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:23.731871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:23.732174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:23.732441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:23.734945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:23.817843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:23.819548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:23.823422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:23.826932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:23.836388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1113/2236] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:22:23.853830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcd380-a6ad-42c8-b7a9-cad3af2e9a03 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:23.859785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:23.860850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:23.861310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:23.861761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:23.864614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:23.881398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:23.884466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d6f4a-28cd-4cb3-bdb0-24a266cae80e service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:23.900323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1124/2237] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:29.737029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:29.750404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc255d2-219d-4ab6-8193-64c8fcd009a5 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:29.759448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:29.760111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:29.760391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:29.760635 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:29.762821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:29.826274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:29.827837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:29.837150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1114/2238] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:31.091335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:31.091866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:31.091973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:31.109626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] MFA Rules not processed for user `e4e4d39c5ed249bc9dc097ba4c24b3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:22:31.111083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:31.118555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1125/2239] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:22:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:22:31.434737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:31.445040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca8add-af64-4432-981b-bb9d7f58af36 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:31.449204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:31.450113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:31.450459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:31.450820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:31.452867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:31.463385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:31.464919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:31.473242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1115/2240] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:31.629267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:31.644620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b5f49-5edb-4cd9-a1e0-95f227e36fdd None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:31.650855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:31.651537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:31.651822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:31.652095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:31.653959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:31.712907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:31.714500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:31.723391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1126/2241] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:31.792982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:31.794549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:31.809928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf59ac-6ba4-4689-b6a9-68efc1419480 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:31.815130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:31.815967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:31.816250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:31.816525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:31.818479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:31.830688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:31.832388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b2828-04e4-472b-9534-07f67a5a2820 service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:31.843805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1116/2242] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:41.719355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=65 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:41.839274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=74 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:42.600273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:22:42.612311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff8b40-e2e6-4e68-97f4-8de68b89cfde service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:22:42.619462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:22:42.620071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:42.620378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:42.620649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:42.622762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:42.636063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:22:42.637665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:22:42.648883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1127/2243] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:22:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:22:47.521050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:22:47.521593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:22:47.521593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:22:47.541870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] MFA Rules not processed for user `829c30cd914f48548b987bd6e39ee774`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:22:47.543063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:22:47.551373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1117/2244] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:22:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:22:52.644881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:22:57.535214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:26.098840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:24:26.100650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:24:26.110579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:24:26.125688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0aa89-bc7c-4e22-8577-0619894331c9 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:24:26.131879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:24:26.132520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:24:26.132867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:24:26.133058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:24:26.134881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:24:26.147949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:24:26.149504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:24:26.160108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1118/2245] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:24:26.164516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bac33-a2c2-41a9-9ea3-a2050ed6b389 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:24:26.168486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:24:26.169174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:24:26.169450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:24:26.169718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:24:26.171653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:24:26.235627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:24:26.237115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:24:26.248159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1128/2246] 10.222.0.45 () {60 vars in 1396 bytes} [Wed May 25 16:24:26 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:24:26.295703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:24:26.308530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ff33c-5c27-43a6-aa51-204d9048a28a service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:24:26.316653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:24:26.317409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:24:26.317748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:24:26.318078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:24:26.320591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:24:26.395085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:24:26.396722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:24:26.406754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1119/2247] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:24:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:24:36.244342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=48 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:24:36.402563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=34 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:25:15.483410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:25:15.495834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217d9a0-4132-46f2-b629-50c5ace02fba service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:25:15.501479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:25:15.502122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:25:15.502406 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:25:15.502682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:25:15.511504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:25:15.513101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:25:15.524088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1129/2248] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:25:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:25:25.520051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:26.468226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:26:26.473947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:26:26.476063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:26:26.482149 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2f5b1-f601-4bcf-a9d8-c1c3da5e8052 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:26:26.487561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:26:26.487964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:26:26.488351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:26:26.488627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:26:26.489516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5da45-29c3-4857-966d-a172704b207a service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:26:26.490684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:26:26.493620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:26:26.494404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:26:26.494741 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:26:26.495075 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:26:26.504551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:26:26.505448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:26:26.505994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:26:26.506872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:26:26.515307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1130/2249] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:26:26.516403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1120/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:26:36.511145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:26:36.512434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=6 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:18.782213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:18.792945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f7fd5-4f5b-46fd-bb0d-052aa920458b service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:18.797553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:18.798199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:18.798484 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:18.798752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:18.806644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:18.808132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:18.816336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1131/2251] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:28:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:28:26.582264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:26.592147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cde4-e9e1-4672-96e0-538b706cc09d service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:26.596684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:26.597325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:26.597606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:26.597878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:26.608970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:26.616110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:26.618472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:26.622595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1121/2252] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:28:26.628181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce89944-8c17-4470-8f0b-068b7bd453cd service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:26.632550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:26.633278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:26.633611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:26.633888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:26.644781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:26.646283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:26.657538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1132/2253] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:28:26.673248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:26.680970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9c943-b59f-4f7d-a7f3-df392ef5603e service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:26.685213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:26.686116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:26.686426 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:26.686703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:26.696003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:26.697505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:26.711041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:26.720824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211deb4f-36b8-43b6-a164-11a84900d598 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:26.725965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:26.727017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:26.727471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:26.727749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:26.729843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1122/2254] 10.222.0.45 () {60 vars in 1396 bytes} [Wed May 25 16:28:26 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:28:26.737952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:26.739421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:26.768799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1133/2255] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:28:26.840791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:26.853078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad88613-9600-416b-970e-c91ec6bd4045 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:26.859085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:26.859754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:26.860035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:26.860308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:26.868695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:26.870280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:26.898294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1123/2256] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:28:27.046261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:28:27.065433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664a2fe-6aa8-4f0a-b16e-b8698b133f4b service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:28:27.072575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:28:27.073225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:28:27.073467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:28:27.073762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:28:27.083182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:28:27.084853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:28:27.113395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1134/2257] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:28:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:28:36.895787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=32 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:28:37.110646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=38 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:17.451070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:30:17.452837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:30:17.616416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32482b-961d-438a-9d3b-d0a6c7980d19 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:30:17.622073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:30:17.622722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:30:17.623002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:30:17.623307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:30:17.625229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:30:17.637097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:30:17.638684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:30:17.648577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1124/2258] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:30:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:30:26.814535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:30:26.842111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9199-7810-4bce-9ef8-c9666d4fe88e service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:30:26.845725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:30:26.846372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:30:26.846670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:30:26.846909 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:30:26.856416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:30:26.857884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:30:26.868659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:30:26.890978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1135/2259] 10.222.0.45 () {60 vars in 1396 bytes} [Wed May 25 16:30:26 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:30:26.940821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:30:26.951811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557dccc-80e8-4f64-9306-b9e9f14fecce service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:30:26.956160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2378b3-e025-444a-a29b-c88647efc839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:30:26.956799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2378b3-e025-444a-a29b-c88647efc839 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:30:26.957172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2378b3-e025-444a-a29b-c88647efc839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:30:26.957350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2378b3-e025-444a-a29b-c88647efc839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:30:26.965417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:26.966712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2378b3-e025-444a-a29b-c88647efc839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:30:26.967851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81ab27-b215-43a1-ad10-0fe64a3a2e81 service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:30:26.968390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2378b3-e025-444a-a29b-c88647efc839 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:30:26.974013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:30:26.974674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:30:26.975029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:30:26.975404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:30:26.983769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:30:26.985449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:30:26.995934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1125/2260] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:30:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:30:26.997650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1136/2261] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:30:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:30:36.991657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:30:36.995072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=35 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:32:27.590506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:32:27.592117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:32:27.620150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580497-9b2b-4611-8dc6-6bcc29d286e8 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:32:27.625789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:32:27.626443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:32:27.626724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:32:27.627001 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:32:27.695693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:32:27.697283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:32:27.716173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1126/2262] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:32:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:32:28.972855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:32:28.973361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:32:28.973669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:32:29.020013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] MFA Rules not processed for user `7da83fc4029c4cdebca07c7247669bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:32:29.021490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:32:29.029023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1137/2263] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:32:30.095794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:32:30.097489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:32:30.181877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f8fd4-a939-4fc7-9cbc-d8f3f3bc8603 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:32:30.185550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:32:30.186218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:32:30.186499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:32:30.186762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:32:30.194019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:32:30.195507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:32:30.203647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1127/2264] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:32:34.585167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:32:34.614957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd997f-d255-468f-a3a5-f3f63e85960a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:32:34.623528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:32:34.624195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:32:34.624475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:32:34.624749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:32:34.634771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:32:34.636664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:32:34.649524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1138/2265] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:32:40.200520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=76 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:32:44.644931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=17 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:33:24.770077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:33:24.778954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb6ead-cc0b-4205-b748-6966930a58d0 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:33:24.783126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:33:24.783796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:33:24.784099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:33:24.784394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:33:24.786525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:33:24.798306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:33:24.800342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:33:24.808771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1128/2266] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:33:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:33:27.108059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:33:27.120277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5471a3d-e334-4c45-b7f1-73ae2f20ac83 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:33:27.127237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:33:27.127915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:33:27.128194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:33:27.128465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:33:27.130624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:33:27.209997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:33:27.211640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:33:27.220624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1139/2267] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:33:27.504492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:33:27.514857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea8c9d-b4d9-4c26-9378-98e8c8176d26 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:33:27.519405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:33:27.519998 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:33:27.520281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:33:27.520557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:33:27.522508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:33:27.606820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:33:27.608290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:33:27.617491 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1129/2268] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:33:27.837104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:33:27.847198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547f589-0c0c-42dd-aa0a-05ee470cb23f service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:33:27.851747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:33:27.852390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:33:27.852669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:33:27.852947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:33:27.855021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:33:27.932499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:33:27.933947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:33:27.943779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1140/2269] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:33:27.993586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:33:28.002492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420967ab-a105-4793-880a-11f12e81e3c5 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:33:28.006784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:33:28.007487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:33:28.007834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:33:28.008108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:33:28.010195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:33:28.084442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:33:28.086042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:33:28.095599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1130/2270] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:33:37.939040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=66 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:33:38.091432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=72 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:35:23.437104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:35:23.449576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea3d6-e19e-41d1-85d4-22b5e6fe86de service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:35:23.455401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:35:23.456040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:35:23.456320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:35:23.456594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:35:23.465379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:35:23.466964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:35:23.476849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1141/2271] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:35:26.903537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:35:26.964749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585d4bf-fdd8-473b-b745-05085f9bd1a3 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:35:26.969255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:35:26.969902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:35:26.970184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:35:26.970458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:35:26.972446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:35:27.040716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:35:27.042281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:35:27.052434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1131/2272] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:35:27.223830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:35:27.234114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc482a-81aa-4e96-8dc1-258efcd0b190 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:35:27.238171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:35:27.238798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:35:27.239086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:35:27.239389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:35:27.241367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:35:27.330168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:35:27.331636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:35:27.343692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1142/2273] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:35:37.047460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=48 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:35:37.336923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=39 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:37:28.730543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:37:28.732161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:37:28.757138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce52078-dc6e-4c12-8868-21eca5c63576 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:37:28.762138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:37:28.762821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:37:28.763101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:37:28.763409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:37:28.765678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:37:28.791558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:37:28.793011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:37:28.802996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1132/2274] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:37:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:37:38.798057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=16 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:38:26.793320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:26.804526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758fd17-7360-43d6-95ea-e15b9fc9dbb5 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:26.809350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:26.809999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:26.810274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:26.810547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:26.818564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:26.820068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:26.828373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1143/2275] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:27.454892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:27.463952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b35da-0a6f-4740-9708-322d5c6b878c service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:27.469419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:27.470250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:27.470587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:27.470867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:27.486590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:27.491268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:27.521941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1133/2276] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:28.031477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:28.047182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf7f74-35ef-4c4c-9a76-beb6c1276d61 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:28.054603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:28.056664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:28.056664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:28.056664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:28.067371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:28.067586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:28.103783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:28.105389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:28.106228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1144/2277] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:28.116867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46794b9-bf25-42d3-989e-12e619c2d52f service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:28.120974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:28.121313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:28.121650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:28.122056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:28.131180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:28.133909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:28.166821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1134/2278] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:28.219797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:28.229036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f522b6-77a8-4082-bd96-dc0f04bc5259 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:28.232675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:28.233327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:28.233605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:28.233870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:28.248899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:28.250469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:28.277938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1145/2279] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:29.587176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:29.596720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbc57e-086b-450e-8628-e538128e5123 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:29.600275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:29.600921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:29.601195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:29.601500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:29.603432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:29.618095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:29.619599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:29.630966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1135/2280] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:29.862232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:29.873129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322ad5f-39fe-41f8-bb63-c81bd2fd1590 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:29.876975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:29.877627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:29.877907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:29.878183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:29.880114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:29.894875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:29.896477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:29.907896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1146/2281] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:31.022843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:31.025380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:31.048414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34419f-155a-46a1-b4fb-9bf931710b18 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:31.068821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:31.070658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:31.071108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:31.071598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:31.073832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:31.107603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:31.111293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:31.129192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1136/2282] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:31.621637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:31.624299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:31.635968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6fe53-8759-4e8a-a1d5-ad9ef1ecc95e service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:31.640968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:31.641875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:31.642372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:31.642865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:31.644868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:31.762786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:31.764939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:31.799623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1147/2283] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:35.878480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:35.880277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:35.918684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca459d-1616-482a-8657-a30cf430ab1f service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:35.932831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:35.933503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:35.933815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:35.934079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:35.936094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:35.961878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:35.963566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:35.974359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1137/2284] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:40.389746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:40.401062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430641-1753-4053-aa01-394124a8a25b service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:40.412981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:40.412981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:40.412981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:40.412981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:40.413333 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:40.422696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:40.424347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:40.437078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1148/2285] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:38:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:38:40.452885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:40.454331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:40.470269 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569618c-6bd5-430f-b6ad-8f287447087f service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:40.475122 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:40.476087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:40.476366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:40.476653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] PATH_INFO: `/v3/users/7da83fc4029c4cdebca07c7247669bd0` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:40.477834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da83fc4029c4cdebca07c7247669bd0)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:40.479823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:40.528829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da83fc4029c4cdebca07c7247669bd0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.537429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da83fc4029c4cdebca07c7247669bd0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.538062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da83fc4029c4cdebca07c7247669bd0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.538767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da83fc4029c4cdebca07c7247669bd0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.551049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da83fc4029c4cdebca07c7247669bd0'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.563272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1138/2286] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:38:40 2022] DELETE /identity/v3/users/7da83fc4029c4cdebca07c7247669bd0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:38:40.742297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:40.758236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380978f2-3100-4f42-9ac9-5206f6228cde service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:40.786182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:38:40.817116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:40.817990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:40.818272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:40.818549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] PATH_INFO: `/v3/projects/01367a52e9104f85baec4b18ef8bf258` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:40.819780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01367a52e9104f85baec4b18ef8bf258)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:40.821693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:40.869811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01367a52e9104f85baec4b18ef8bf258', 'request_id': 'req-8c4b28f8-e65f-428f-8280-9ccb78316e80'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.875870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01367a52e9104f85baec4b18ef8bf258', 'request_id': 'req-8c4b28f8-e65f-428f-8280-9ccb78316e80'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.881894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01367a52e9104f85baec4b18ef8bf258', 'request_id': 'req-8c4b28f8-e65f-428f-8280-9ccb78316e80'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.894923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] The token cache is being invalidate because project 01367a52e9104f85baec4b18ef8bf258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:38:40.895244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.895873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:40.897480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1149/2287] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:38:40 2022] DELETE /identity/v3/projects/01367a52e9104f85baec4b18ef8bf258 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:38:40.901752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:40.903204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:40.916432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad33e37-8024-4af9-9bd3-c10787fceb80 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:40.955175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:38:40.982305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:40.983171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:40.983496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:40.983833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] PATH_INFO: `/v3/users/b57ce75dd2c049f6954779ef6bea6e1e` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:40.997385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57ce75dd2c049f6954779ef6bea6e1e)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:40.999388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:41.045260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57ce75dd2c049f6954779ef6bea6e1e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.053098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57ce75dd2c049f6954779ef6bea6e1e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.053731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57ce75dd2c049f6954779ef6bea6e1e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.054419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57ce75dd2c049f6954779ef6bea6e1e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.066476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57ce75dd2c049f6954779ef6bea6e1e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.080696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1139/2288] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:38:40 2022] DELETE /identity/v3/users/b57ce75dd2c049f6954779ef6bea6e1e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:38:41.264970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:38:41.266621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:38:41.279768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b28f8-e65f-428f-8280-9ccb78316e80 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:38:41.361391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:38:41.362265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:38:41.362545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:38:41.362999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] PATH_INFO: `/v3/projects/c470e629abac4ab9975657d55c2347e6` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:38:41.377777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c470e629abac4ab9975657d55c2347e6)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:38:41.379802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:38:41.427144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c470e629abac4ab9975657d55c2347e6', 'request_id': 'req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.429968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:38:41.436347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c470e629abac4ab9975657d55c2347e6', 'request_id': 'req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.442227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c470e629abac4ab9975657d55c2347e6', 'request_id': 'req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.455913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] The token cache is being invalidate because project c470e629abac4ab9975657d55c2347e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:38:41.456319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.457068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:38:41.458716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1150/2289] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:38:41 2022] DELETE /identity/v3/projects/c470e629abac4ab9975657d55c2347e6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:38:51.075168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:38:51.452830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=5,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:40:27.376983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:40:27.378586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:40:27.445971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:40:27.448560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:40:27.539114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e6483-4b13-44ce-9daa-5408412b66a2 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:40:27.590245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b05ca5-fdb1-48e0-970d-5607ae7bbd01 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:40:27.595601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:40:27.596323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:40:27.596669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:40:27.597030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:40:27.599019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:40:27.613343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:40:27.614949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:40:27.622523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:40:27.623215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:40:27.623498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:40:27.623767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:40:27.625389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1151/2290] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:40:27.625595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:40:27.658363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:40:27.702445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:40:27.704341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:40:27.726520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1140/2291] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:40:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:40:37.620915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=52 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:40:37.724143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=21 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:42:30.124390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:42:30.128155 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:42:30.158683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a4e4d-024a-4ac7-bf19-56f614cc8ae7 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:42:30.164555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:42:30.165216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:42:30.165498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:42:30.165772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:42:30.167593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:42:30.256576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:42:30.258212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:42:30.283058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1152/2292] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:42:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:42:40.279475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=41 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:43:28.027443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:43:28.039490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac432c9d-c690-46bf-94d0-d28c993a933c service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:43:28.046332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:43:28.046982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:43:28.047260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:43:28.047563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:43:28.049590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:28.129566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:43:28.131261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:43:28.141086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1141/2293] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:43:28.978819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:43:28.980498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:28.996245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3209a59-c9e1-46b2-a49a-51db4fe057d7 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:43:29.003470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:43:29.004116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:43:29.004409 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:43:29.004682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:43:29.006624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:29.079788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:43:29.081421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:43:29.091277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1153/2294] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:43:29.309812 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:43:29.311503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:29.313867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:43:29.315584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:29.391650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c3138-ebe9-46b2-8e70-5d0c1f8e98a6 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:43:29.395473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:43:29.396123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:43:29.396360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1ea34-be38-44b6-bd9b-f72bf1c16ada service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:43:29.396501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:43:29.396667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:43:29.398578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:29.400175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:43:29.400814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:43:29.401091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:43:29.401357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:43:29.403038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:29.411928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:43:29.413365 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:43:29.417521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:43:29.419488 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfffdf-4c00-4413-aeca-284357ed9993 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:43:29.426438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1142/2295] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:43:29.433411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1154/2296] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:43:29.734981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:43:29.744040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a482d-bd93-43fb-8181-be4140138e93 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:43:29.748643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:43:29.749281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:43:29.749559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:43:29.749831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:43:29.751953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:43:29.762233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:43:29.763833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:43:29.772422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1143/2297] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:43:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:43:39.428004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=68 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:43:39.769040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=74 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:30.236597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:30.237105 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:30.237221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:30.300119 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:30.301004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:30.372949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1155/2298] 10.222.0.45 () {58 vars in 967 bytes} [Wed May 25 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:30.425798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:30.427244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:30.534335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5d4e0-90bc-4203-89bf-a0bd09267f59 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:30.540358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:30.540956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:30.541239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:30.541520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:30.550695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:30.552547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:30.561021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1144/2299] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:44:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:44:31.150088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:31.152379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:31.169625 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63392e-f8f4-4248-8be2-a9fbfabb469d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:31.173664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:31.174993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:31.175456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:31.175856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:31.177783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:31.266325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:31.268018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ce12f-630a-41d2-9593-404170c52151 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:31.281351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1156/2300] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:34.243008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:34.245576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:34.283459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6dc8-3d50-494d-a30f-354088a00383 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:34.283970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6dc8-3d50-494d-a30f-354088a00383 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:34.284329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6dc8-3d50-494d-a30f-354088a00383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:34.330492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f1ec6dc8-3d50-494d-a30f-354088a00383 None None] MFA Rules not processed for user `06ba885a0b164134898c42a332feba76`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:34.333301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f1ec6dc8-3d50-494d-a30f-354088a00383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:34.354172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31aced-dc85-4c5c-8676-a5b9bae45548 service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:34.359809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1157/2301] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:44:34.368352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:34.369186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:34.369472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:34.369863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:34.371938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:34.451899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:34.452518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:34.452872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:34.481863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:34.483591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:34.488167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] MFA Rules not processed for user `a0c9f3f10fd142439521e4b36cf33157`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:34.489540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:34.494047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1145/2302] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:34.505936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1158/2303] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:34.567750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:34.581328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:34.585569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff794a-4b2a-4131-a561-eb49e8841740 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:34.590178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:34.591102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:34.591628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:34.592094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:34.594225 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:34.687322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:34.689060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:34.701533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1146/2304] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:34.866505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:34.886021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef2517-6105-49b5-aa08-a9840d19e791 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:34.903049 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:34.903757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:34.904037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:34.904306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:34.912074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:34.925011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:34.926470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d186e-f515-4107-903c-1b200590a1e4 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:34.940239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1159/2305] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:44:35.079046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.093161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9fa4d-7c47-453e-ba21-f554b3164363 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.097527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.098259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.098695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.098967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.100906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:35.112503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.114059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6460f-e4eb-4ea6-a757-99e4165803ae service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.125110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1147/2306] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:35.180818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.181552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.182042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.207275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:35.249463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:35.250749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:35.261707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1160/2307] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:35.270140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.270637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.270760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.288647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:35.290188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:35.298102 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1148/2308] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:35.302393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.313433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bcbd8-b56f-48a0-931e-ca5f64a19cdf None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.319605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.320601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.321081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.321539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.322442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:44:35.322911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.324747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.339190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1161/2309] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:44:35.343628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.353480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd88b7-154c-4018-a6d4-2feb6c0891ab None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.358116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.358774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.359052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.359467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.360234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.362159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.404448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1149/2310] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:44:35 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:44:35.409840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.428387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e3038-6827-43e5-8237-cb651b8c0d48 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.481535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.483283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:35.524214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.525505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.525850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.526135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.527446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.530337 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.592547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1162/2311] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:44:35 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:44:35.594073 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.617203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688e3a-58ed-4d4d-bf2e-0c4fbba5bb19 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.617619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0fed-f0ed-4568-bf94-eae369b835ab admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.622373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.622535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.623046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.623359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.623587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.623712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.624032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.624393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.624522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.626128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.626540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:35.639338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.645651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.647289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1163/2312] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:44:35.648371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.659315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1150/2313] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:44:35.659315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.671719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366559df-350d-444f-94d6-0db8ddb2d4f8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.673584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324c7bf-660f-4825-9a34-f88327c64f00 service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.679590 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce371b-4a11-4aed-aec5-a255bbcc110f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.680236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce371b-4a11-4aed-aec5-a255bbcc110f service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.680551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce371b-4a11-4aed-aec5-a255bbcc110f service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.680826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce371b-4a11-4aed-aec5-a255bbcc110f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.681582 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.682300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.682640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.682982 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.683777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.685457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.691065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce371b-4a11-4aed-aec5-a255bbcc110f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.692686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce371b-4a11-4aed-aec5-a255bbcc110f service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.697843 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1151/2314] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:44:35.702016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.703746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1164/2315] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:35.712558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698107b-59e7-4e73-a038-0771ba77b925 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.717366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.718345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.718792 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.718967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] PATH_INFO: `/v3/projects/dfd05f6349194d52b2a23b550cae2105/users/d7d9118b197b44aebe1d8d9abe52f58f/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.735169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd05f6349194d52b2a23b550cae2105, user_id=d7d9118b197b44aebe1d8d9abe52f58f, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.737862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.741431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:35.755357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1152/2316] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:44:35 2022] PUT /identity/v3/projects/dfd05f6349194d52b2a23b550cae2105/users/d7d9118b197b44aebe1d8d9abe52f58f/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:44:35.760520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.760775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.761052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.785621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:35.786953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:35.855210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1165/2317] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:35.865872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:35.929049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf53e6-1147-413a-b31d-07a7c4a6c76c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:35.932752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:35.933402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:35.933684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:35.933950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:35.944557 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:35.946284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:35.956841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1153/2318] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:39.446476 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:39.498387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:39.558861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7d008-96cb-4ac3-a4a3-635536e0926e None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:39.566415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:39.567807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:39.568284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:39.568986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:39.571987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:39.587247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:39.589401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf3ed57-35ac-4cb0-9544-57b6ba11ca74 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:39.601389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1166/2319] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:39.974066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:39.993669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5862f7c-2e81-4bfe-85d6-9f850994fc52 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:40.003328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:40.005022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:40.005672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:40.006835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:40.012649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:40.026746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:40.028622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:40.043268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1154/2320] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:42.859052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:42.859632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:42.859632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:42.887351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] MFA Rules not processed for user `d7d9118b197b44aebe1d8d9abe52f58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:42.888557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:42.956222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1167/2321] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:42.960844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:42.971876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e14f9-d08a-4218-a010-570931edafb4 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:42.976780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:42.977444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:42.977729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:42.978005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:42.978697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:42.980700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.011529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1155/2322] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:44:42 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:44:43.012778 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:43.023471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ae14-78b8-4996-9315-8be03839f0f1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:43.090679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:43.091463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:43.091749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:43.092024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:43.092721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:43.094650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.114856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1168/2323] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:44:43 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:44:43.120143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:43.130949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2cdfa-32af-4955-9ec0-e98170acd2b4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:43.136947 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:43.137680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:43.137963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:43.138234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:43.138961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:43.140631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.153943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1156/2324] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:44:43.158475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:43.169268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f550109-1038-49d3-9bb5-74b3d834b925 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:43.175193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:43.176131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:43.176411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:43.176684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] PATH_INFO: `/v3/projects/b343418b4585401f83e031de7761d580/users/7183cb63d3974892bb162640ff928480/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:43.194166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b343418b4585401f83e031de7761d580, user_id=7183cb63d3974892bb162640ff928480, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:43.196981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.211985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1169/2325] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:44:43 2022] PUT /identity/v3/projects/b343418b4585401f83e031de7761d580/users/7183cb63d3974892bb162640ff928480/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:44:43.216013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:43.226252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d230af-6ab1-4724-bd02-a2c22c3fed19 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:43.284507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:43.285323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:43.285703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:43.286009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:43.286733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:43.288414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.299010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1157/2326] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:44:43.302970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:43.313311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310c581-dc3f-48d7-9806-435fc10d06da admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:43.318275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef6103-7485-40f1-9311-cc5a5560bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:43.319242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef6103-7485-40f1-9311-cc5a5560bdce admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:43.319546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef6103-7485-40f1-9311-cc5a5560bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:43.319847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef6103-7485-40f1-9311-cc5a5560bdce admin admin] PATH_INFO: `/v3/projects/b343418b4585401f83e031de7761d580/users/7183cb63d3974892bb162640ff928480/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:43.322221 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef6103-7485-40f1-9311-cc5a5560bdce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b343418b4585401f83e031de7761d580, user_id=7183cb63d3974892bb162640ff928480, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:43.324993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef6103-7485-40f1-9311-cc5a5560bdce admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.331602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:43.336345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1170/2327] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:44:43 2022] PUT /identity/v3/projects/b343418b4585401f83e031de7761d580/users/7183cb63d3974892bb162640ff928480/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:44:43.796248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:43.850776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:44:43.880182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0f96-b969-446a-9119-e6df432b0e71 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:43.960509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:43.961458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:43.962454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:43.962454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:43.965548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:43.984258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:43.986085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:43.998997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1158/2328] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:49.093477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6d29-a01d-4e75-8b51-e00cfbbb71e8 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:49.094004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6d29-a01d-4e75-8b51-e00cfbbb71e8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:49.094004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6d29-a01d-4e75-8b51-e00cfbbb71e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:49.123853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-434d6d29-a01d-4e75-8b51-e00cfbbb71e8 None None] MFA Rules not processed for user `7183cb63d3974892bb162640ff928480`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:49.125075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-434d6d29-a01d-4e75-8b51-e00cfbbb71e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:49.209694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1171/2329] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:49.223291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:44:49.235606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df097cf2-38b2-485f-8a0a-66d7fc44d657 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:44:49.241996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:44:49.242668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:49.243049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:49.243468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:49.307848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:44:49.309463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:44:49.319053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1159/2330] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:44:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:44:50.513250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:44:50.513852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:44:50.514027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:44:50.552377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] MFA Rules not processed for user `d7d9118b197b44aebe1d8d9abe52f58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:44:50.553863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:44:50.565835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1172/2331] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:44:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:44:59.315310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=68 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:45:00.537033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=37 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:45:31.103212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:45:31.172564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d07f84-cb6a-4e11-9c02-b3a8fd382140 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:45:31.178180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:45:31.178822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:45:31.179099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:45:31.179395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:45:31.187700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:45:31.189285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:45:31.199316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1160/2332] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:45:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:45:41.195440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=32 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:45:53.934607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:45:53.947668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6da0c1-fc20-49c3-b694-73f0b09c3fbe None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:45:53.952667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:45:53.953315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:45:53.953606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:45:53.953883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:45:53.955964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:45:53.968792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:45:53.970944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:45:53.984216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1173/2333] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:45:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:45:57.404237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:45:57.474051 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a158-8d7e-4253-8886-6b30d6f99991 service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:45:57.480179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:45:57.481094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:45:57.481338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:45:57.481639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] PATH_INFO: `/v3/users/d7d9118b197b44aebe1d8d9abe52f58f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:45:57.483000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d9118b197b44aebe1d8d9abe52f58f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:45:57.485275 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:45:57.534280 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d9118b197b44aebe1d8d9abe52f58f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.543016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d9118b197b44aebe1d8d9abe52f58f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.543694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d9118b197b44aebe1d8d9abe52f58f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.544393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d9118b197b44aebe1d8d9abe52f58f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.556614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d9118b197b44aebe1d8d9abe52f58f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.568974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1161/2334] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:45:57 2022] DELETE /identity/v3/users/d7d9118b197b44aebe1d8d9abe52f58f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:45:57.748966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:45:57.761814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8798b9c-cf55-4d41-a4bd-e5ab3445b80b service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:45:57.820497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:45:57.821653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:45:57.821934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:45:57.822440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] PATH_INFO: `/v3/projects/dfd05f6349194d52b2a23b550cae2105` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:45:57.823692 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd05f6349194d52b2a23b550cae2105)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:45:57.825607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:45:57.876422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd05f6349194d52b2a23b550cae2105', 'request_id': 'req-eb978e52-4728-44c9-ad10-05937d5e3ffb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.882475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd05f6349194d52b2a23b550cae2105', 'request_id': 'req-eb978e52-4728-44c9-ad10-05937d5e3ffb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.889271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd05f6349194d52b2a23b550cae2105', 'request_id': 'req-eb978e52-4728-44c9-ad10-05937d5e3ffb'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.903945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] The token cache is being invalidate because project dfd05f6349194d52b2a23b550cae2105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:45:57.904234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.904860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:57.906460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1174/2335] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:45:57 2022] DELETE /identity/v3/projects/dfd05f6349194d52b2a23b550cae2105 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:45:57.910579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:45:57.912014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:45:57.926208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0351-ad37-43e1-afc4-82a6571b4d4d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:45:57.985663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:45:57.986575 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:45:57.986886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:45:57.987170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] PATH_INFO: `/v3/users/7183cb63d3974892bb162640ff928480` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:45:57.988408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7183cb63d3974892bb162640ff928480)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:45:57.990356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:45:58.012137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:45:58.039541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7183cb63d3974892bb162640ff928480'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.049305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7183cb63d3974892bb162640ff928480'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.050065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7183cb63d3974892bb162640ff928480'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.050900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7183cb63d3974892bb162640ff928480'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.068599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b2b4a78c-1293-4f28-8449-c2703b5d8012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7183cb63d3974892bb162640ff928480'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.081945 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1162/2336] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:45:57 2022] DELETE /identity/v3/users/7183cb63d3974892bb162640ff928480 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:45:58.263784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:45:58.265228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:45:58.284052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb978e52-4728-44c9-ad10-05937d5e3ffb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:45:58.341834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:45:58.342695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:45:58.342977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:45:58.343268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] PATH_INFO: `/v3/projects/b343418b4585401f83e031de7761d580` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:45:58.344485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b343418b4585401f83e031de7761d580)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:45:58.346416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:45:58.367509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:45:58.395800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b343418b4585401f83e031de7761d580', 'request_id': 'req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.401774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b343418b4585401f83e031de7761d580', 'request_id': 'req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.407766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b343418b4585401f83e031de7761d580', 'request_id': 'req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.425345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] The token cache is being invalidate because project b343418b4585401f83e031de7761d580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:45:58.425754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.426802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:45:58.429090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1175/2337] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:45:58 2022] DELETE /identity/v3/projects/b343418b4585401f83e031de7761d580 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:46:08.078015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:46:08.420480 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:46:31.910873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:46:31.911451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:46:31.911451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:46:31.929834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] MFA Rules not processed for user `a0c9f3f10fd142439521e4b36cf33157`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:46:31.931042 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:46:31.993729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1163/2338] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:46:41.986648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=25 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:48:29.167377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:48:29.169512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:29.247035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0be6d-cae4-4810-9ec8-32d1d5788a6a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:48:29.251316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:48:29.251960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:48:29.252239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:48:29.252510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:48:29.254449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:29.338365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:48:29.340446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:48:29.353351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1176/2339] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:48:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:48:29.407576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:48:29.418463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5e526-f1d6-4dab-b59c-b4b361fde893 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:48:29.422774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:48:29.423452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:48:29.423737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:48:29.424014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:48:29.426118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:29.504045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:48:29.505614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:48:29.514700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1164/2340] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:48:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:48:32.144730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:48:32.146730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:32.206357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6dc0d-967a-4125-baed-bd560aa4cd56 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:48:32.210549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:48:32.211233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:48:32.211513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:48:32.211783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:48:32.213786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:32.223749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:48:32.225275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:48:32.233947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1177/2341] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:48:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:48:36.590414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:48:36.592305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:36.604316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca90623-a3ee-4ba0-b21b-9788144817a2 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:48:36.609093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:48:36.609743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:48:36.610027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:48:36.610313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:48:36.612341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:36.689309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:48:36.690768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:48:36.711067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1165/2342] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:48:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:48:36.782600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:48:36.793242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bddd8-4b1f-405a-b490-fd408028fba0 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:48:36.797860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:48:36.798502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:48:36.798784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:48:36.799060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:48:36.801019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:48:36.825582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:48:36.827013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:48:36.846478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1178/2343] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:48:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:48:46.708176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=69 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:48:46.844079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:50:29.607352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:50:29.626858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18acaf3-2b10-4e78-b355-6ef4ba92bc11 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:50:29.630921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:50:29.631597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:50:29.631881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:50:29.632156 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:50:29.634090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:50:29.741643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:50:29.743091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:50:29.762587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1166/2344] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:50:29.807352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:50:29.834271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bba7-083c-448c-b4b8-5e5d4369549e service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:50:29.838136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:50:29.838769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:50:29.839042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:50:29.839343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:50:29.841312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:50:29.920113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:50:29.921543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:50:29.941445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1179/2345] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:50:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:50:38.429074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:50:38.430705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:50:38.562545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787906dc-94c1-49cd-8190-6a56a3876e9c service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:50:38.568217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:50:38.568866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:50:38.569143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:50:38.569421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:50:38.571246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:50:38.582659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:50:38.584264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:50:38.594125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1167/2346] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:50:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:50:39.938517 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=41 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:50:48.590240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:22.656407 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:22.658065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:22.752978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42ecd5-c1dd-4a7e-9637-4e2c1f07578e service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:22.760313 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9044-1352-4230-a449-085939a82c30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:22.760989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9044-1352-4230-a449-085939a82c30 service glance] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:22.761277 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9044-1352-4230-a449-085939a82c30 service glance] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:22.761556 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9044-1352-4230-a449-085939a82c30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:22.763441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9add9044-1352-4230-a449-085939a82c30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application [None req-9add9044-1352-4230-a449-085939a82c30 service glance] Could not find project: dfd05f6349194d52b2a23b550cae2105.: keystone.exception.ProjectNotFound: Could not find project: dfd05f6349194d52b2a23b550cae2105. May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 25 16:52:22.790486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:52:22.792629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self._validate_token_resources() May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 16:52:22.794099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.get_or_create( May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application with Lock( May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._enter() May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.creator() May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application created_value = creator( May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 16:52:22.795373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 16:52:22.797856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dfd05f6349194d52b2a23b550cae2105. May 25 16:52:22.797856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: ERROR keystone.server.flask.application May 25 16:52:22.797856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1180/2347] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:22 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 25 16:52:23.026756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:23.028363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:23.046472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80698406-12bb-42ae-9f63-d32789240aca service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:23.054408 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:23.055188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:23.055549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:23.055834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:23.058219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:23.133133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9044-1352-4230-a449-085939a82c30 service glance] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:23.142720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9044-1352-4230-a449-085939a82c30 service glance] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:23.146777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:23.147496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:23.147775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:23.148044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:23.149793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:23.162161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:23.164050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:23.191108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1168/2348] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:23.240582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:23.242347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:23.266252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1181/2349] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:24.456523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:24.475944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb5b3d-84a9-406b-be68-8e37a3e94357 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:24.481704 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:24.482782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:24.483326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:24.483933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:24.487130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:24.504472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:24.506184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:24.521200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1169/2350] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:24.876306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:24.880915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:24.914160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a957bd0-ad96-4398-b233-90c25fb16ab9 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:24.924716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:24.925393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:24.925864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:24.926314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:24.931123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:24.947650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:24.949689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:24.964557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1182/2351] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:25.812298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:25.835064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff96a4-f3a5-499f-8b77-226a9e3cefc5 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:25.859670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:25.860402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:25.860686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:25.861477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:25.865787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:25.904740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:25.906621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:25.925808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1170/2352] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:27.210312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:27.211901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:27.237364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c7549-353a-44d1-8dd5-a24fb12ca272 service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:27.243073 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:27.243853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:27.244247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:27.244611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:27.246473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:27.264174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:27.265872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:27.280423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1183/2353] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:27.366219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:27.371284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:27.403882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0aaa5-614e-466e-8a6e-7bb3fb2150a9 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:27.426764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:27.427743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:27.428285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:27.428560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] PATH_INFO: `/v3/users/e4e4d39c5ed249bc9dc097ba4c24b3d2` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:27.430650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e4d39c5ed249bc9dc097ba4c24b3d2)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:27.432634 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:27.495633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e4d39c5ed249bc9dc097ba4c24b3d2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.506721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e4d39c5ed249bc9dc097ba4c24b3d2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.507721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e4d39c5ed249bc9dc097ba4c24b3d2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.508507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e4d39c5ed249bc9dc097ba4c24b3d2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.524830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e4d39c5ed249bc9dc097ba4c24b3d2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.558673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1171/2354] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:27 2022] DELETE /identity/v3/users/e4e4d39c5ed249bc9dc097ba4c24b3d2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:27.577576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:27.588207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381f78-0987-473e-ae4d-088e4c25bf41 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:27.629703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:27.652099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:27.653210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:27.653492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:27.653761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:27.656118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:27.733228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:27.734868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093129e2-08b0-40ee-85ce-8b6759504b3a service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:27.746141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1184/2355] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:27.761449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:27.762907 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:27.787262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89037356-4c70-45a0-a38d-89ac34469607 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:27.798440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:27.800598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:27.802233 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:27.803136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] PATH_INFO: `/v3/projects/b36e59bfe72a49679b3b3657f5a65882` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:27.804918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36e59bfe72a49679b3b3657f5a65882)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:27.807264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:27.820298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:27.896160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36e59bfe72a49679b3b3657f5a65882', 'request_id': 'req-852b2d88-e4c1-4fa5-9606-4940a13335d8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.904554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36e59bfe72a49679b3b3657f5a65882', 'request_id': 'req-852b2d88-e4c1-4fa5-9606-4940a13335d8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.913550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36e59bfe72a49679b3b3657f5a65882', 'request_id': 'req-852b2d88-e4c1-4fa5-9606-4940a13335d8'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.935447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] The token cache is being invalidate because project b36e59bfe72a49679b3b3657f5a65882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:27.935879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.937242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-852b2d88-e4c1-4fa5-9606-4940a13335d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:27.939673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1172/2356] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:27 2022] DELETE /identity/v3/projects/b36e59bfe72a49679b3b3657f5a65882 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:27.945510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:27.945800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:27.946282 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:27.970086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:27.972089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:28.047526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1185/2357] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:28.055838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.056383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.056760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.087588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:28.088877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:28.097731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1173/2358] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:28.102644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.118046 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465847a-6bd5-40ce-afb9-32ee00358ef9 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.125868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.126554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.126837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.127109 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.127876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:28.128183 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.129854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.142941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1186/2359] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:52:28.147434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.158402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a7758-7744-4d09-af5d-15b83d5e9aa7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.164551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.165300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.165675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.166139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.166987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.169022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.207962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1174/2360] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:28 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:28.213233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.236766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7707-e862-4693-82b5-a085764d58f6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.308083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.309042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.309441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.309817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.310610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.312864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.331454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:28.344468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1187/2361] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:28 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:28.357200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.380713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62dfca-67a9-4e8c-9c55-485b74dc7086 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.391581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.392726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.393007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.393443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.394351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.396016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.408659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1175/2362] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:52:28.413243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.423695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf894a-521c-44df-880b-adfe9c67b245 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.429102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af59abc-f24b-4d48-b1a7-89e6f21b75f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.429823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59abc-f24b-4d48-b1a7-89e6f21b75f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.430128 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59abc-f24b-4d48-b1a7-89e6f21b75f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.430429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af59abc-f24b-4d48-b1a7-89e6f21b75f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.431210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59abc-f24b-4d48-b1a7-89e6f21b75f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.432945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af59abc-f24b-4d48-b1a7-89e6f21b75f4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.447660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1188/2363] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:28.450321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.461311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc46749-82fc-4cf4-aa82-34efdf5f7f2b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.466336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.467277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.467734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.468188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] PATH_INFO: `/v3/projects/eed6bcf1b81541df9b1476c021f5c220/users/c9f67808fe2440cd9d92dd3b6d0f2ff9/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.487580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed6bcf1b81541df9b1476c021f5c220, user_id=c9f67808fe2440cd9d92dd3b6d0f2ff9, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.490722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.508259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1176/2364] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:28 2022] PUT /identity/v3/projects/eed6bcf1b81541df9b1476c021f5c220/users/c9f67808fe2440cd9d92dd3b6d0f2ff9/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:28.520230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.521249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.521733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.564982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] MFA Rules not processed for user `c9f67808fe2440cd9d92dd3b6d0f2ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:28.567306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:28.602639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.605586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:28.697055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1189/2365] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:28.698219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f868b4e-162c-4c45-a762-6782769366c5 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.703317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.704056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:28.704205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.704471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.705000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] PATH_INFO: `/v3/users/b53b45a485b14e0b9273c019dc9ec206` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.706520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:28.707669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53b45a485b14e0b9273c019dc9ec206)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.709661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.756697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:28.777685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53b45a485b14e0b9273c019dc9ec206'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:28.789830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53b45a485b14e0b9273c019dc9ec206'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:28.790691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53b45a485b14e0b9273c019dc9ec206'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:28.791928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53b45a485b14e0b9273c019dc9ec206'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:28.799779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd6251-7709-49e8-bf7d-b92c5fc4204a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:28.805770 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:28.806428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:28.806727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:28.807235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:28.808378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53b45a485b14e0b9273c019dc9ec206'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:28.808894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:28.820304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:28.821937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:28.827517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1177/2366] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:28 2022] DELETE /identity/v3/users/b53b45a485b14e0b9273c019dc9ec206 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:28.834114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1190/2367] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:29.010811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:29.012276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:29.092985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe322da-9e47-406b-9baf-d0fc729df4cd admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:29.101309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:29.102620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:29.103397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:29.103687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] PATH_INFO: `/v3/projects/073368e447af465abb41aa556ee46dc9` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:29.105886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] RBAC: Authorizing `identity:delete_project(project_id=073368e447af465abb41aa556ee46dc9)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:29.108296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:29.176666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073368e447af465abb41aa556ee46dc9', 'request_id': 'req-975982a2-8ed9-4fed-ab9d-1c7a6348783c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:29.184799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073368e447af465abb41aa556ee46dc9', 'request_id': 'req-975982a2-8ed9-4fed-ab9d-1c7a6348783c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:29.191350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073368e447af465abb41aa556ee46dc9', 'request_id': 'req-975982a2-8ed9-4fed-ab9d-1c7a6348783c'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:29.214487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] The token cache is being invalidate because project 073368e447af465abb41aa556ee46dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:29.214808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:29.215530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-975982a2-8ed9-4fed-ab9d-1c7a6348783c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:29.217202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1178/2368] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:29 2022] DELETE /identity/v3/projects/073368e447af465abb41aa556ee46dc9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:31.636577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:31.637996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:31.652226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cad1f5-c5bf-4157-88d5-6811ada3de6e service nova] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:31.727880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:31.728706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:31.729001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:31.729280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] PATH_INFO: `/v3/users/c9f67808fe2440cd9d92dd3b6d0f2ff9` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:31.730468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f67808fe2440cd9d92dd3b6d0f2ff9)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:31.732440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:31.734843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:31.784969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f67808fe2440cd9d92dd3b6d0f2ff9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:31.785984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f67808fe2440cd9d92dd3b6d0f2ff9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:31.786813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f67808fe2440cd9d92dd3b6d0f2ff9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:31.796470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f67808fe2440cd9d92dd3b6d0f2ff9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:31.810137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f67808fe2440cd9d92dd3b6d0f2ff9'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:31.825740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1191/2369] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:31 2022] DELETE /identity/v3/users/c9f67808fe2440cd9d92dd3b6d0f2ff9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:31.830561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:31.831081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:31.831266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:31.849862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:31.851222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:31.887111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:31.916327 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1179/2370] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:31.926115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:31.927578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:31.996475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef16d2-c9fe-4ae1-9fa3-7d862ada9233 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.000411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ed05c-a019-4c18-9524-a7a95d592e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.001064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ed05c-a019-4c18-9524-a7a95d592e8f service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.001378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ed05c-a019-4c18-9524-a7a95d592e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.001656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ed05c-a019-4c18-9524-a7a95d592e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.011043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ed05c-a019-4c18-9524-a7a95d592e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.012536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ed05c-a019-4c18-9524-a7a95d592e8f service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.022023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1192/2371] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:32.308419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.310783 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:32.329140 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040692f-61dd-4c28-9b42-5e0dae1853d5 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.334056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.335017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.335218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.335505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] PATH_INFO: `/v3/projects/eed6bcf1b81541df9b1476c021f5c220` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.336681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed6bcf1b81541df9b1476c021f5c220)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.338621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.400123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed6bcf1b81541df9b1476c021f5c220', 'request_id': 'req-43f999b9-41a2-4afc-aa00-479cbbdab4cb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:32.410910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed6bcf1b81541df9b1476c021f5c220', 'request_id': 'req-43f999b9-41a2-4afc-aa00-479cbbdab4cb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:32.418274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed6bcf1b81541df9b1476c021f5c220', 'request_id': 'req-43f999b9-41a2-4afc-aa00-479cbbdab4cb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:32.434336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] The token cache is being invalidate because project eed6bcf1b81541df9b1476c021f5c220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:32.434616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:32.435364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-43f999b9-41a2-4afc-aa00-479cbbdab4cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:32.437931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1180/2372] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:32 2022] DELETE /identity/v3/projects/eed6bcf1b81541df9b1476c021f5c220 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:32.442829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.443125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.443538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.462619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:32.463921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:32.561136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1193/2373] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:32.568961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.569251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.569533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.588118 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:32.589326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:32.597502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1181/2374] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:32.601753 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.613949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35283db-4330-4622-ab31-7c9a1033b01b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.618842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.619546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.619828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.620106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.620828 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:32.621121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.622731 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.634891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1194/2375] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:52:32.639481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.648992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09566f-278c-4a21-81bb-348d24e097d4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.653729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.654388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.654660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.654940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.655674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.657724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.692065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1182/2376] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:32 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:32.693260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.708445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274ae1d-04f0-4dba-a691-d4e4b6d00148 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.720347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:32.787800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.788706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.788904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.789184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.790332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.792588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.822068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1195/2377] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:32 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:32.823403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.835005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a394be-719e-4aa8-87f7-4927c8aaaed0 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.839769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.840813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.841152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.841487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.842424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.844726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.859193 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1183/2378] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:32.861198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.872716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f2faf-4461-480e-95e4-99fa3ca30beb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.877388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abe0f4-4ff6-432b-8e40-c4d2fa5bdbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.878058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abe0f4-4ff6-432b-8e40-c4d2fa5bdbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.878343 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abe0f4-4ff6-432b-8e40-c4d2fa5bdbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.878620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abe0f4-4ff6-432b-8e40-c4d2fa5bdbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.879382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abe0f4-4ff6-432b-8e40-c4d2fa5bdbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.880994 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abe0f4-4ff6-432b-8e40-c4d2fa5bdbc6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.892217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1196/2379] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:52:32.899109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:32.909564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7258018-e4d3-4a93-889d-6a3c3d4ff14c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:32.914524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:32.915452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.915780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.916046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] PATH_INFO: `/v3/projects/22e6ab2d979a414b8f4c7ee778e58af8/users/b0b098bd5c144c1e8d30e5ec671e0d19/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.932699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e6ab2d979a414b8f4c7ee778e58af8, user_id=b0b098bd5c144c1e8d30e5ec671e0d19, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:32.935468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:32.949658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1184/2380] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:32 2022] PUT /identity/v3/projects/22e6ab2d979a414b8f4c7ee778e58af8/users/b0b098bd5c144c1e8d30e5ec671e0d19/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:32.961487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:32.961781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:32.962062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:32.989252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] MFA Rules not processed for user `b0b098bd5c144c1e8d30e5ec671e0d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:32.990461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:33.064424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1197/2381] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:33.071916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.144638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354edb7-b51a-412c-93cd-9e9399f59ebe admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.150307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.151124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.151501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.151837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.152611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.155030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.158756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:33.186754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1185/2382] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:33 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:33.190627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.202970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842883b2-5d05-4497-8528-489b25fe0b74 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.272725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.273401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.273695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.273965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.274661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.276945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.297677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1198/2383] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:33 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:33.301736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.312107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac12f-2859-473a-be69-8fc1be6f21fb admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.317008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.317680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.317993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.318266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.318992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.320673 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.333195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1186/2384] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:33.338312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.355761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966f05e-a2c1-40a8-aa3a-b36c2de4216f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.363041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.364048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.364329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.364603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] PATH_INFO: `/v3/projects/73dbfbfca4dc41a8a82487b4bad7e4b5/users/6626da70b0c84df98a0fe990923eb9c7/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.368306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:33.385958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dbfbfca4dc41a8a82487b4bad7e4b5, user_id=6626da70b0c84df98a0fe990923eb9c7, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.389954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.404446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1199/2385] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:33 2022] PUT /identity/v3/projects/73dbfbfca4dc41a8a82487b4bad7e4b5/users/6626da70b0c84df98a0fe990923eb9c7/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:33.408444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.419412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9406a-90f4-4ba3-ba54-c3c9e805f452 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.477625 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb84734-7b7c-4168-982a-203f7d62f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.478266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84734-7b7c-4168-982a-203f7d62f3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.478570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84734-7b7c-4168-982a-203f7d62f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.478828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb84734-7b7c-4168-982a-203f7d62f3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.479580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84734-7b7c-4168-982a-203f7d62f3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.481164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb84734-7b7c-4168-982a-203f7d62f3e4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.491290 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1187/2386] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:33.495570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.505912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a40af9-d920-43ed-81ae-848109a268a9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.510854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.511764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.512039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.512307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] PATH_INFO: `/v3/projects/73dbfbfca4dc41a8a82487b4bad7e4b5/users/6626da70b0c84df98a0fe990923eb9c7/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.514429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dbfbfca4dc41a8a82487b4bad7e4b5, user_id=6626da70b0c84df98a0fe990923eb9c7, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.517140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.527767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1200/2387] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:33 2022] PUT /identity/v3/projects/73dbfbfca4dc41a8a82487b4bad7e4b5/users/6626da70b0c84df98a0fe990923eb9c7/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:33.538653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.538946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.539246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.570512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] MFA Rules not processed for user `6626da70b0c84df98a0fe990923eb9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:33.572338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:33.643762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1188/2388] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:33.655441 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.657499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:33.715132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88045cbd-3e77-4a4e-bca1-0df3b507e706 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.719431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.720067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.720346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.720624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.729724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.731179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.740666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1201/2389] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:33.828145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:33.837824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f7408-d010-451e-a11b-e13118e92b49 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:33.841636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:33.842306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:33.842643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:33.842935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:33.904379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:33.909203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:33.910688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:33.920361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1189/2390] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:36.560954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:36.562665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:36.624900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4510187-c366-4e55-afb8-b9de41a7b867 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:36.629151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:36.629798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:36.630075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:36.630347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:36.632117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:36.699932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:36.703562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:36.717713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1202/2391] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:37.042106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:37.043631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:37.056735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d0658-29e3-4347-8997-5a6f306a5d1d service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:37.061168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:37.061810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:37.062324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:37.062583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:37.068724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:37.094106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:37.095589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:37.106598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1190/2392] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:40.804399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:40.805879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:40.838842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:40.891558 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d1430-ea2d-4d0d-bad6-e42237a641d2 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:40.897469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:40.898247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:40.898624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:40.898995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:40.901184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:40.904032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:40.905977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:40.918490 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:40.920614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:40.921973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ace5e-98f6-4af3-bff6-5cea5e4695f5 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:40.934063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:40.935237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:40.936177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:40.937231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1203/2393] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:40.937861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] PATH_INFO: `/v3/users/829c30cd914f48548b987bd6e39ee774` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:40.939218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] RBAC: Authorizing `identity:delete_user(user_id=829c30cd914f48548b987bd6e39ee774)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:40.942060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.009270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829c30cd914f48548b987bd6e39ee774'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.018132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829c30cd914f48548b987bd6e39ee774'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.018777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829c30cd914f48548b987bd6e39ee774'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.019416 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829c30cd914f48548b987bd6e39ee774'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.031527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829c30cd914f48548b987bd6e39ee774'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.043996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1191/2394] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:40 2022] DELETE /identity/v3/users/829c30cd914f48548b987bd6e39ee774 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:41.073683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.075294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.100390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c4f1e-f5e4-43a0-b1b7-b3cd33ee0295 service placement] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.165435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.166321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.166604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.166880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] PATH_INFO: `/v3/users/06ba885a0b164134898c42a332feba76` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.168126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ba885a0b164134898c42a332feba76)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.170389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.219726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ba885a0b164134898c42a332feba76'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.220417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ba885a0b164134898c42a332feba76'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.221164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ba885a0b164134898c42a332feba76'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.232167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ba885a0b164134898c42a332feba76'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.249576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7584f2f4-cfba-452f-ab49-17396100e128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ba885a0b164134898c42a332feba76'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.252838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.254591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.263649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1204/2395] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:41 2022] DELETE /identity/v3/users/06ba885a0b164134898c42a332feba76 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:41.269951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31c80-7fdd-4d4c-82cb-dba6b6ab626e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.329041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.330109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.330486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.331466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] PATH_INFO: `/v3/projects/bd0c9fdb2e8e4e72ac2835b0482ae824` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.332682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0c9fdb2e8e4e72ac2835b0482ae824)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.336471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.389862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0c9fdb2e8e4e72ac2835b0482ae824', 'request_id': 'req-cadfb5e2-dcb8-4631-bc64-b28fdec26842'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.397456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0c9fdb2e8e4e72ac2835b0482ae824', 'request_id': 'req-cadfb5e2-dcb8-4631-bc64-b28fdec26842'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.399554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:41.405970 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0c9fdb2e8e4e72ac2835b0482ae824', 'request_id': 'req-cadfb5e2-dcb8-4631-bc64-b28fdec26842'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.422138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] The token cache is being invalidate because project bd0c9fdb2e8e4e72ac2835b0482ae824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:41.422371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.423199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.425063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1192/2396] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:41 2022] DELETE /identity/v3/projects/bd0c9fdb2e8e4e72ac2835b0482ae824 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:41.430094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda6e0b-ce01-4bc7-a55e-215c744974fe None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.430420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda6e0b-ce01-4bc7-a55e-215c744974fe None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.430696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda6e0b-ce01-4bc7-a55e-215c744974fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.449934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5eda6e0b-ce01-4bc7-a55e-215c744974fe None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:41.451140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5eda6e0b-ce01-4bc7-a55e-215c744974fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.453097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.455079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.492296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:41.526632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1205/2397] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:41.534336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.534698 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.534985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.538044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfb5e2-dcb8-4631-bc64-b28fdec26842 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.542706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.543603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.543878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.544148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] PATH_INFO: `/v3/projects/c3003077416c4ce997e3aa7e47e8e3b7` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.545347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3003077416c4ce997e3aa7e47e8e3b7)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.547306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.553686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:41.554979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.563371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1206/2398] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:41.567473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.576252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33001f-87bf-4a18-9000-1fc305d63d41 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.581263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.581926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.582214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.582479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.583240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:41.583552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.585178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.598584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3003077416c4ce997e3aa7e47e8e3b7', 'request_id': 'req-0d88c2dc-3fae-4117-8830-4f6e57a48787'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.599303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1207/2399] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:52:41.603941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.609981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3003077416c4ce997e3aa7e47e8e3b7', 'request_id': 'req-0d88c2dc-3fae-4117-8830-4f6e57a48787'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.614284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caaab5-0b49-4570-8465-f94eba076055 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.615917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3003077416c4ce997e3aa7e47e8e3b7', 'request_id': 'req-0d88c2dc-3fae-4117-8830-4f6e57a48787'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.630839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] The token cache is being invalidate because project c3003077416c4ce997e3aa7e47e8e3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:41.631125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.631814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0d88c2dc-3fae-4117-8830-4f6e57a48787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:41.633657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1193/2400] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:41 2022] DELETE /identity/v3/projects/c3003077416c4ce997e3aa7e47e8e3b7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:41.639334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81576cd-6991-4e0a-a6f4-a95acd0516d3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.639630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81576cd-6991-4e0a-a6f4-a95acd0516d3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.639891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81576cd-6991-4e0a-a6f4-a95acd0516d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.660003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f81576cd-6991-4e0a-a6f4-a95acd0516d3 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:41.661563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f81576cd-6991-4e0a-a6f4-a95acd0516d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.682847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.683475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.683760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.684038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.684726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.686691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.720951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1208/2401] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:41.722089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.723730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.729229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1194/2402] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:41.737778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.738063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.738340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.758857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:41.760117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:41.768810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:41.793545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a366e65-81cf-4b3a-a646-4b5872c5bbb0 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.798405 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.799106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.799576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.799857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.800545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.802493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.823502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1195/2403] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:41.827021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1209/2404] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:41.828871 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.829019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.838993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348afa93-a8f0-4831-99ad-27b426e67b77 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.839211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdb54b-077d-43c5-b4f7-fb6bcc7800a5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.844171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.844438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.844812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.844957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.845106 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.845242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.845352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.845461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.846075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:41.846213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.846493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.847734 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.848110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.858509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1196/2405] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:41.862453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1210/2406] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:52:41.862848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.866835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.873479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cda0b-7a80-4622-98d0-68fe41364c48 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.876999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28928ba-4958-4b91-9693-c2584aeed89c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.877617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.878271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.878552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.878821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.879580 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.881188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.881987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.882844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.883182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.883842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.884685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.887096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.891514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1197/2407] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:52:41.895460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.905555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611e6dd-5296-4e26-9c2e-e0628a123712 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:41.909408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:41.910358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142401f-3fbe-423e-9b56-be7d2ec7eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:41.911345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142401f-3fbe-423e-9b56-be7d2ec7eda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.911640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142401f-3fbe-423e-9b56-be7d2ec7eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.911932 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142401f-3fbe-423e-9b56-be7d2ec7eda9 admin admin] PATH_INFO: `/v3/projects/d9f6bdad2e0148ba90e5aee400bb1207/users/9768edda563b495487bb30c79485a700/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:41.928039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1211/2408] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:41.929832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:41.934996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142401f-3fbe-423e-9b56-be7d2ec7eda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9f6bdad2e0148ba90e5aee400bb1207, user_id=9768edda563b495487bb30c79485a700, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:41.937892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142401f-3fbe-423e-9b56-be7d2ec7eda9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:41.954699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1198/2409] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:41 2022] PUT /identity/v3/projects/d9f6bdad2e0148ba90e5aee400bb1207/users/9768edda563b495487bb30c79485a700/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:41.966549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:41.966841 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:41.967211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.000630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57f23d-e8a8-4041-a636-814b1ff7daaa admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:42.001237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] MFA Rules not processed for user `9768edda563b495487bb30c79485a700`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:42.002446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:42.064551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:42.065309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.065650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.065984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.067686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:42.072846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:42.078057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1199/2410] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:42.091113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:42.093307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:42.099204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1212/2411] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:41 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:42.103413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:42.114564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb388457-bf01-4b14-95c3-d83609c51312 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:42.120682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:42.121401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.121712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.122366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.122870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:42.124694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:42.137358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1213/2412] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:52:42.140004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:42.153544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c63e4-d57a-4fbb-b182-5c908e4ffc22 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:42.159754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:42.160672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.161112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.161494 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.162807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:42.165456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:42.167608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098045-ae6e-4a3c-8571-1c0e119080e3 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:42.171641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ec1d2-3c53-42cd-8d31-67d67c6c5cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:42.172301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec1d2-3c53-42cd-8d31-67d67c6c5cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.172584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec1d2-3c53-42cd-8d31-67d67c6c5cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.172860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec1d2-3c53-42cd-8d31-67d67c6c5cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.181798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1214/2413] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:52:42.185767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:42.188636 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ec1d2-3c53-42cd-8d31-67d67c6c5cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:42.191910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208ec1d2-3c53-42cd-8d31-67d67c6c5cd7 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:42.197371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da94b47-7b82-4750-9e29-96305570cbf3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:42.198990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:42.203013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:42.203360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1200/2414] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:52:42.203803 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.204086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.204420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] PATH_INFO: `/v3/projects/e85ae209587a4c408afb7fd926922b39/users/a06b95033ffd45cd9873c0b2618be401/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.221387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85ae209587a4c408afb7fd926922b39, user_id=a06b95033ffd45cd9873c0b2618be401, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:42.224240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:42.238621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1215/2415] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:42 2022] PUT /identity/v3/projects/e85ae209587a4c408afb7fd926922b39/users/a06b95033ffd45cd9873c0b2618be401/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:42.249666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.249979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.251589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.281565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] MFA Rules not processed for user `a06b95033ffd45cd9873c0b2618be401`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:42.282780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:42.365564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1201/2416] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:42.377638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:42.379979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:42.440581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:42.507772 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd311f39-5d66-44f4-9af1-8b6c5810e262 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:42.513972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b780e9-a90f-40ba-9854-7f5311e9d7cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:42.514389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b780e9-a90f-40ba-9854-7f5311e9d7cd service nova] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:42.514707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b780e9-a90f-40ba-9854-7f5311e9d7cd service nova] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:42.515907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b780e9-a90f-40ba-9854-7f5311e9d7cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:42.528352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b780e9-a90f-40ba-9854-7f5311e9d7cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:42.538892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b780e9-a90f-40ba-9854-7f5311e9d7cd service nova] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:42.546447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1216/2417] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:50.113458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:50.178450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b12154-6ee9-418e-8c38-b360e68064bc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:50.183977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:50.184893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:50.185174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:50.185449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] PATH_INFO: `/v3/users/a06b95033ffd45cd9873c0b2618be401` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:50.186743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06b95033ffd45cd9873c0b2618be401)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:50.188730 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:50.238899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06b95033ffd45cd9873c0b2618be401'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.246293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06b95033ffd45cd9873c0b2618be401'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.246893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06b95033ffd45cd9873c0b2618be401'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.247523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06b95033ffd45cd9873c0b2618be401'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.259777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06b95033ffd45cd9873c0b2618be401'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.272108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1202/2418] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:50 2022] DELETE /identity/v3/users/a06b95033ffd45cd9873c0b2618be401 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:50.276827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:50.277332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:50.277438 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:50.295089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:50.296303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:50.362175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1217/2419] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:50.372117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:50.373669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:50.384937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:50.433190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f41850-d567-4e4c-9243-1d0d86ffdfb4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:50.437319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedad844-da83-43fc-8156-8e8dcc2b346b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:50.437937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad844-da83-43fc-8156-8e8dcc2b346b service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:50.438237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad844-da83-43fc-8156-8e8dcc2b346b service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:50.438492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedad844-da83-43fc-8156-8e8dcc2b346b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:50.448129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad844-da83-43fc-8156-8e8dcc2b346b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:50.449578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedad844-da83-43fc-8156-8e8dcc2b346b service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:50.459309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1203/2420] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:50.743627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:50.745176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:50.760913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9afb53-3e34-4541-8b23-bee39f7d3190 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:50.767728 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:50.768579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:50.768857 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:50.769212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] PATH_INFO: `/v3/projects/e85ae209587a4c408afb7fd926922b39` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:50.770354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85ae209587a4c408afb7fd926922b39)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:50.772335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:50.825717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85ae209587a4c408afb7fd926922b39', 'request_id': 'req-e091eb70-23b3-4659-b331-15cd6ffdabbf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.834481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85ae209587a4c408afb7fd926922b39', 'request_id': 'req-e091eb70-23b3-4659-b331-15cd6ffdabbf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.841140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85ae209587a4c408afb7fd926922b39', 'request_id': 'req-e091eb70-23b3-4659-b331-15cd6ffdabbf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.855734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] The token cache is being invalidate because project e85ae209587a4c408afb7fd926922b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:50.856019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.856705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e091eb70-23b3-4659-b331-15cd6ffdabbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:50.858744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1218/2421] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:50 2022] DELETE /identity/v3/projects/e85ae209587a4c408afb7fd926922b39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:50.864516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:50.864808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:50.865092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:50.883961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:50.885220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:50.955294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1204/2422] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:50.963709 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:50.964063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:50.964446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:50.984285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:50.985576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:50.993477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1219/2423] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:50.997978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.008663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1036c5b-6e9c-4307-a63d-020d71d8cc48 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.014201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.014859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.015317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.015592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.016311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:51.016612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.018229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.031475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1205/2424] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:52:51.035854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.046197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78098f-a7f0-40b2-a976-e9c64c237334 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.051003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.051701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.051983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.052255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.053131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.055737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.091255 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1220/2425] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:51.095995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.107249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7502a8c-e4cf-4f1a-945b-7165a564a83f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.178895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.180597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.181039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.181476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.182326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.184566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.213767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1206/2426] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:51.217601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.237769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e66fe-9a5c-43f4-bb71-554bbff54f20 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.242552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.243260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.243546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.243823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.244552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.246316 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.257486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1221/2427] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:51.262722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.273009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b2fd6-3c49-41a9-9392-9f3901aea8c1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.277579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dafad3-5f03-413a-a10f-99a9f0fde09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.278249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dafad3-5f03-413a-a10f-99a9f0fde09d admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.278530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dafad3-5f03-413a-a10f-99a9f0fde09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.278803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dafad3-5f03-413a-a10f-99a9f0fde09d admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.279715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dafad3-5f03-413a-a10f-99a9f0fde09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.281322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dafad3-5f03-413a-a10f-99a9f0fde09d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.291743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1207/2428] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:51.295958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.301454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:51.307278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c674b3-f5e5-4f58-9264-269f3e03c8c8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.313329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.314228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.314519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.314986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] PATH_INFO: `/v3/projects/e79d112bce66434f9b50d9d48300971d/users/7e215d71ba9f4ac19371bc48d6c10e8a/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.329937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79d112bce66434f9b50d9d48300971d, user_id=7e215d71ba9f4ac19371bc48d6c10e8a, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.332604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.347374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1222/2429] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:51 2022] PUT /identity/v3/projects/e79d112bce66434f9b50d9d48300971d/users/7e215d71ba9f4ac19371bc48d6c10e8a/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:51.359115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.359440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.359721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.387985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] MFA Rules not processed for user `7e215d71ba9f4ac19371bc48d6c10e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:51.389255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:51.394578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:51.458371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1208/2430] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:51.462893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.524922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839300-7d02-4af1-96fb-dd72b80972b9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.530461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.531218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.531515 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.531777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.532464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.534393 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.564382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1223/2431] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:51.568456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.579927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043c34b-327e-4b89-9d1f-b9cafef0ac7f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.640943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.641556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.641836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.642089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.642802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.644765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.669550 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1209/2432] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:51.673660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.684691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee813-a3f6-4a9a-9d0a-2ad35a7cd5d9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.689504 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.690172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.690462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.690724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.691500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.693085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.705040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1224/2433] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:51.708407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.723801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec929a-3fa4-449e-a82c-bb4975e13804 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.728805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.729692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.729993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.730224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] PATH_INFO: `/v3/projects/bef8b2d702734d3db0ebe648e9d5248f/users/ba6de03243bf40dabe41be51865fbe8f/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.735016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.736864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:51.747505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef8b2d702734d3db0ebe648e9d5248f, user_id=ba6de03243bf40dabe41be51865fbe8f, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.749329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7db9d7-f9aa-4cfa-8078-8b51dc45f762 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.750350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.754389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.755298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.755598 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.755889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] PATH_INFO: `/v3/users/9768edda563b495487bb30c79485a700` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.757384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9768edda563b495487bb30c79485a700)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.759453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.765125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1210/2434] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:51 2022] PUT /identity/v3/projects/bef8b2d702734d3db0ebe648e9d5248f/users/ba6de03243bf40dabe41be51865fbe8f/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:51.768903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.809330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9768edda563b495487bb30c79485a700'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:51.810003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9768edda563b495487bb30c79485a700'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:51.810755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9768edda563b495487bb30c79485a700'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:51.820290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9768edda563b495487bb30c79485a700'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:51.834288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07acdf-4594-45d2-9bac-a72f7614e471 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.835096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1807b641-4fe6-4294-ba9f-71e13772b115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9768edda563b495487bb30c79485a700'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:51.839097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.839799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.840082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.840368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.841121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.842760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.848864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1225/2435] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:51 2022] DELETE /identity/v3/users/9768edda563b495487bb30c79485a700 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:51.852660 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1211/2436] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:52:51.853339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.853716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.854389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.856847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.858853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:51.871828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1101d60-2b19-4814-8110-1cec2aae2a17 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:51.872380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:51.873626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:51.878454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:51.893528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:51.935338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e270e4b-549e-4da9-9ffb-16975159bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:51.936396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270e4b-549e-4da9-9ffb-16975159bd26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.936671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270e4b-549e-4da9-9ffb-16975159bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.936801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1226/2437] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:51.936936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e270e4b-549e-4da9-9ffb-16975159bd26 admin admin] PATH_INFO: `/v3/projects/bef8b2d702734d3db0ebe648e9d5248f/users/ba6de03243bf40dabe41be51865fbe8f/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.938898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270e4b-549e-4da9-9ffb-16975159bd26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef8b2d702734d3db0ebe648e9d5248f, user_id=ba6de03243bf40dabe41be51865fbe8f, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:51.941760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e270e4b-549e-4da9-9ffb-16975159bd26 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:51.946563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:51.947999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:51.953144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1212/2438] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:51 2022] PUT /identity/v3/projects/bef8b2d702734d3db0ebe648e9d5248f/users/ba6de03243bf40dabe41be51865fbe8f/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:51.963418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:51.963702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:51.964086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:51.990440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] MFA Rules not processed for user `ba6de03243bf40dabe41be51865fbe8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:51.991653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:52.004178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb12cf-3868-4c16-893c-d17a059d67d1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.051547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.052193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.052472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.052741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.061179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1213/2439] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:52.072960 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.074393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:52.121201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.122658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.132288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1227/2440] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:52:52.134776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bad4a-8eb7-43e3-84bc-4dcbe7aea7fc None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.138573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.139353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.139631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.139904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.149450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.150965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.160965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1214/2441] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:52:52.237585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.247973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a62a9-dbed-4a37-b780-e96dd515edf8 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.252374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.253026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.253301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.253569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.255696 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:52.306615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:52.342785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.344351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea77eaf-030d-4503-a1a7-0f5ba34c2c65 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.354301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1228/2442] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:52.436215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.438068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:52.455260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6b18f-9e9d-4674-bced-6d798cf69cd9 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.461298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.462764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.463524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.464050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] PATH_INFO: `/v3/projects/d9f6bdad2e0148ba90e5aee400bb1207` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.467068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9f6bdad2e0148ba90e5aee400bb1207)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.471864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.522574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:52.541022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9f6bdad2e0148ba90e5aee400bb1207', 'request_id': 'req-d9311c0b-0c35-4edb-bbaa-ba447c99a726'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:52.547438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9f6bdad2e0148ba90e5aee400bb1207', 'request_id': 'req-d9311c0b-0c35-4edb-bbaa-ba447c99a726'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:52.553079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9f6bdad2e0148ba90e5aee400bb1207', 'request_id': 'req-d9311c0b-0c35-4edb-bbaa-ba447c99a726'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:52.566472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] The token cache is being invalidate because project d9f6bdad2e0148ba90e5aee400bb1207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:52.566760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:52.567410 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d9311c0b-0c35-4edb-bbaa-ba447c99a726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:52.568953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1215/2443] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:52 2022] DELETE /identity/v3/projects/d9f6bdad2e0148ba90e5aee400bb1207 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:52.574017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.574303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.574575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.591779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:52.592989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:52.653752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1229/2444] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:52.663585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.663931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.664231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.691496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:52.692675 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:52.702126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1216/2445] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:52.706400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.716347 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b207fa-61a3-4467-a7fb-cf17c53392a1 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.723635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.723951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.724234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.724513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.725435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:52.725760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.727798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.743094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1230/2446] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:52:52.747073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.757382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f12470-a2e6-4809-9746-3feeba5876fd None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.762802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.763606 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.763887 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.764165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.764870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.767207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.799938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1217/2447] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:52 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:52.806369 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.818542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c119b30-344a-4ecc-94b5-e2496f774a43 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.884089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.884766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.885053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.885328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.886016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.888001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.910134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1231/2448] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:52 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:52.914728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.927046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc469854-7742-4a8b-aae5-49088815abde admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.932024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.932681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.932965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.933238 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.933981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.935624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.946323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1218/2449] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:52.950299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.960641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a183d8e-3445-47c7-83fd-e84adf60ba52 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.965636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0e022-a0c6-4a40-9186-5e2095d73586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:52.966289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0e022-a0c6-4a40-9186-5e2095d73586 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:52.966569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0e022-a0c6-4a40-9186-5e2095d73586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:52.966843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0e022-a0c6-4a40-9186-5e2095d73586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:52.967606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0e022-a0c6-4a40-9186-5e2095d73586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:52.969196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0e022-a0c6-4a40-9186-5e2095d73586 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:52.979308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1232/2450] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:52.983535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:52.993722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652984d4-ebb2-4f40-9e7c-ed0b641761ab admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:52.999733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.001210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.001497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.001804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] PATH_INFO: `/v3/projects/856502ff46bb46d68a600a470e4d217f/users/7c78692a33e640dc815c112c80d42bf3/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.021064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856502ff46bb46d68a600a470e4d217f, user_id=7c78692a33e640dc815c112c80d42bf3, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.023773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.038705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1219/2451] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:52 2022] PUT /identity/v3/projects/856502ff46bb46d68a600a470e4d217f/users/7c78692a33e640dc815c112c80d42bf3/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:53.050628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.050918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.051193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.080389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] MFA Rules not processed for user `7c78692a33e640dc815c112c80d42bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:53.081631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:53.107600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:53.151143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1233/2452] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:53.156114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.222310 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddf60f-bf36-4bdb-b4bb-df3cc5006cb9 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.227432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.228090 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.228371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.228627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.229306 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.231252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.259992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1220/2453] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:53 2022] POST /identity/v3/projects => generated 405 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:53.264187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.275800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39523c8-f953-482a-b9c9-31b168e3ab18 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.348940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.349640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.349970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.350242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.350932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.352918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.375212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1234/2454] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:53 2022] POST /identity/v3/users => generated 309 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:53.381338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.397852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f6353-e663-4c80-a5e5-495d39cce473 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.404769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.405425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.405696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.405961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.406670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.408331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.419867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1221/2455] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:53.424184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.439549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833315-1d97-4b31-a124-3c4682fa6893 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.440087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.440979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.441225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.441516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] PATH_INFO: `/v3/projects/1879ce9a5e354ac08b1ccd8f4f1cb7cd/users/ed2344ed0a3749299d3006411d0b1547/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.457917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1879ce9a5e354ac08b1ccd8f4f1cb7cd, user_id=ed2344ed0a3749299d3006411d0b1547, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.460649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.474987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1235/2456] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:53 2022] PUT /identity/v3/projects/1879ce9a5e354ac08b1ccd8f4f1cb7cd/users/ed2344ed0a3749299d3006411d0b1547/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:53.478924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.489682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2754e5-b24e-446a-a116-9e6af5f2ca63 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.514153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:53.559517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f830b-3957-4227-94fb-18c270c6268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.560241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f830b-3957-4227-94fb-18c270c6268b admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.560650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f830b-3957-4227-94fb-18c270c6268b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.562046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f830b-3957-4227-94fb-18c270c6268b admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.562046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f830b-3957-4227-94fb-18c270c6268b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.563295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f830b-3957-4227-94fb-18c270c6268b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.573750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1222/2457] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:53.577929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.588576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55973d-0995-4508-944a-cfab095d0121 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.593668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.594650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.595091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.595243 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] PATH_INFO: `/v3/projects/1879ce9a5e354ac08b1ccd8f4f1cb7cd/users/ed2344ed0a3749299d3006411d0b1547/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.597264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1879ce9a5e354ac08b1ccd8f4f1cb7cd, user_id=ed2344ed0a3749299d3006411d0b1547, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.600339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.611204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1236/2458] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:53 2022] PUT /identity/v3/projects/1879ce9a5e354ac08b1ccd8f4f1cb7cd/users/ed2344ed0a3749299d3006411d0b1547/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:53.621484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.621777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.622056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.654513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] MFA Rules not processed for user `ed2344ed0a3749299d3006411d0b1547`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:53.655773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:53.725394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1223/2459] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:53.735767 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:53.737629 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:53.803781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e594131-ff02-4a8c-9f54-d0fee68b3f62 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:53.807702 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d8d1e-21e6-4b60-a8d7-77b35dc07e01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:53.808350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8d1e-21e6-4b60-a8d7-77b35dc07e01 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:53.808636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8d1e-21e6-4b60-a8d7-77b35dc07e01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:53.808904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8d1e-21e6-4b60-a8d7-77b35dc07e01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:53.818733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d8d1e-21e6-4b60-a8d7-77b35dc07e01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:53.820223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d8d1e-21e6-4b60-a8d7-77b35dc07e01 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:53.840170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1237/2460] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:53.973953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:54.047959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ffdba-af78-4fcb-96a0-fa35002e44b4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:54.053363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:54.054258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:54.054542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:54.054820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] PATH_INFO: `/v3/users/7c78692a33e640dc815c112c80d42bf3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:54.056214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c78692a33e640dc815c112c80d42bf3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:54.058138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:54.110162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c78692a33e640dc815c112c80d42bf3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.111905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:54.119219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c78692a33e640dc815c112c80d42bf3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.120035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c78692a33e640dc815c112c80d42bf3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.120942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c78692a33e640dc815c112c80d42bf3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.133417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c78692a33e640dc815c112c80d42bf3'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.145785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1224/2461] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:53 2022] DELETE /identity/v3/users/7c78692a33e640dc815c112c80d42bf3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:54.150493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:54.150873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:54.151247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:54.170056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:54.171290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:54.184028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:54.234610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1238/2462] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:54.246614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:54.248592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:54.318322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcc0e3-23e5-4237-92bb-8d9ed323c70b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:54.323227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:54.323881 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:54.324161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:54.324437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:54.336126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:54.338447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:54.349434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1225/2463] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:54.627852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:54.629548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:54.641868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7a2a-61f7-4256-bc5c-56340a5627d6 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:54.647196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:54.648194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:54.649180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:54.649180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] PATH_INFO: `/v3/projects/856502ff46bb46d68a600a470e4d217f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:54.650196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] RBAC: Authorizing `identity:delete_project(project_id=856502ff46bb46d68a600a470e4d217f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:54.652366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:54.704848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856502ff46bb46d68a600a470e4d217f', 'request_id': 'req-be8aaba6-2dde-4e72-814a-2aba38c7093f'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.710902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856502ff46bb46d68a600a470e4d217f', 'request_id': 'req-be8aaba6-2dde-4e72-814a-2aba38c7093f'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.716859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856502ff46bb46d68a600a470e4d217f', 'request_id': 'req-be8aaba6-2dde-4e72-814a-2aba38c7093f'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.730628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] The token cache is being invalidate because project 856502ff46bb46d68a600a470e4d217f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:54.730906 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.731530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.733235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1239/2464] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:54 2022] DELETE /identity/v3/projects/856502ff46bb46d68a600a470e4d217f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:54.737768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:54.751523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546d858-a8aa-44ae-9d44-e952d66e2aa6 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:54.812099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:54.813006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:54.813298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:54.813558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] PATH_INFO: `/v3/users/ed2344ed0a3749299d3006411d0b1547` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:54.814747 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2344ed0a3749299d3006411d0b1547)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:54.816749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:54.866469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2344ed0a3749299d3006411d0b1547'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.873870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2344ed0a3749299d3006411d0b1547'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.874485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2344ed0a3749299d3006411d0b1547'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.875123 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2344ed0a3749299d3006411d0b1547'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.886128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:54.887291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2344ed0a3749299d3006411d0b1547'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:54.900766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1226/2465] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:54 2022] DELETE /identity/v3/users/ed2344ed0a3749299d3006411d0b1547 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:55.165581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.167917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.181375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8aaba6-2dde-4e72-814a-2aba38c7093f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.192919 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.194430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.241852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.242754 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.243001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.243307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] PATH_INFO: `/v3/users/7e215d71ba9f4ac19371bc48d6c10e8a` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.244521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e215d71ba9f4ac19371bc48d6c10e8a)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.246455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.275066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4102862-6ba9-43e3-b728-4190d5e8d2fe admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.280461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.281362 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.281647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.282251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] PATH_INFO: `/v3/projects/1879ce9a5e354ac08b1ccd8f4f1cb7cd` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.283222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1879ce9a5e354ac08b1ccd8f4f1cb7cd)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.285168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.293248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:55.294869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e215d71ba9f4ac19371bc48d6c10e8a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.295581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e215d71ba9f4ac19371bc48d6c10e8a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.296285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e215d71ba9f4ac19371bc48d6c10e8a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.307120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e215d71ba9f4ac19371bc48d6c10e8a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.321664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-0c3385b5-0b5e-4058-a74d-f6524399769e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e215d71ba9f4ac19371bc48d6c10e8a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.334972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1240/2466] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:55 2022] DELETE /identity/v3/users/7e215d71ba9f4ac19371bc48d6c10e8a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:55.335910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1879ce9a5e354ac08b1ccd8f4f1cb7cd', 'request_id': 'req-761aedc2-2cfb-40fe-b128-e96348ce0331'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.339345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.339662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.339936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.342779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1879ce9a5e354ac08b1ccd8f4f1cb7cd', 'request_id': 'req-761aedc2-2cfb-40fe-b128-e96348ce0331'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.349421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1879ce9a5e354ac08b1ccd8f4f1cb7cd', 'request_id': 'req-761aedc2-2cfb-40fe-b128-e96348ce0331'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.359272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:55.360670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.366899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] The token cache is being invalidate because project 1879ce9a5e354ac08b1ccd8f4f1cb7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:55.367223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.367863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-761aedc2-2cfb-40fe-b128-e96348ce0331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.369820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1227/2467] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:55 2022] DELETE /identity/v3/projects/1879ce9a5e354ac08b1ccd8f4f1cb7cd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:55.374975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5aab7-fcc8-4530-9e32-d95d639f67eb None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.375364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5aab7-fcc8-4530-9e32-d95d639f67eb None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.375737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5aab7-fcc8-4530-9e32-d95d639f67eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.395900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7dd5aab7-fcc8-4530-9e32-d95d639f67eb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:55.397121 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7dd5aab7-fcc8-4530-9e32-d95d639f67eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.424872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1241/2468] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:55.434748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.436164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.461931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1228/2469] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:55.469612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.469992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.470262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.487772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:55.488937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.494035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0920-c492-4d40-9650-f8f2e2b18dd9 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.497061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1229/2470] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:55.498173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.498814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.499459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.499732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.501307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.509681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.510204 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3ae6e-ccc8-4878-97f2-b1fc5522ca5d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.511173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.514856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.515522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.515800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.516068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.516767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:55.517065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.518650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.521691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1242/2471] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:52:55.525546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:55.535461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1230/2472] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:52:55.536636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.546786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80e23-f3f9-405a-9c78-e9ee0dddc0e8 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.551920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.552731 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.553078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.553413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.554189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.556276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.587192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1243/2473] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:55.588782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.599446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d61b5-89e1-46ba-a4df-d4bbbb106d3f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.656664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.657338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.657615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.657886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.658566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.660626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.690342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1231/2474] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:55.691562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.703194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd5268-a2ee-462e-b5ac-6ab2af06669b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.709027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.710238 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.710509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.710793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.711559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.713172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.724627 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1244/2475] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:55.728684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.739191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34a945-8b16-4ad8-9137-34e9b7d9a142 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.744749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.745411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.745686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.745956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.746665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.748649 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.763020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1232/2476] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:55.766327 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.777666 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a7fe1-0218-42b5-8b08-f7a2cb630fd0 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.783722 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a4a47-4d4d-4dce-8232-7bd39929bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.785338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a4a47-4d4d-4dce-8232-7bd39929bf25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.785630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a4a47-4d4d-4dce-8232-7bd39929bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.785907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a4a47-4d4d-4dce-8232-7bd39929bf25 admin admin] PATH_INFO: `/v3/projects/1ca9861301de4fe6893b290a11eca4fb/users/5c28ad94ceb04bb38114f4bc4def0aed/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.807638 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a4a47-4d4d-4dce-8232-7bd39929bf25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca9861301de4fe6893b290a11eca4fb, user_id=5c28ad94ceb04bb38114f4bc4def0aed, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.810985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a4a47-4d4d-4dce-8232-7bd39929bf25 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.826934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.828965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1245/2477] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:55 2022] PUT /identity/v3/projects/1ca9861301de4fe6893b290a11eca4fb/users/5c28ad94ceb04bb38114f4bc4def0aed/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:55.829686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.841375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.841689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.841991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.853265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3f31-1e9f-4aed-b3f5-49bec7d25556 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.863784 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:55.874699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] MFA Rules not processed for user `5c28ad94ceb04bb38114f4bc4def0aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:55.876501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:55.918323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:55.919752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:55.920227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:55.920525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] PATH_INFO: `/v3/projects/e79d112bce66434f9b50d9d48300971d` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:55.922004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79d112bce66434f9b50d9d48300971d)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:55.924479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:55.952591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1246/2478] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:55.957232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:55.970896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d1f7c-060e-4e26-8034-1276b3d668d6 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:55.974170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79d112bce66434f9b50d9d48300971d', 'request_id': 'req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.980629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79d112bce66434f9b50d9d48300971d', 'request_id': 'req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:55.986996 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79d112bce66434f9b50d9d48300971d', 'request_id': 'req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.001031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] The token cache is being invalidate because project e79d112bce66434f9b50d9d48300971d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:56.001396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.002079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.003668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1233/2479] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:55 2022] DELETE /identity/v3/projects/e79d112bce66434f9b50d9d48300971d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:56.007571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.008852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.017906 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:56.032660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.033262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.033550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.033829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.034513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.036460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.065503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1247/2480] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:55 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:56.067306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.068933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.078654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec4ee1-8ee3-4fed-a018-6a9636e61e57 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.134131 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12105fbd-06ec-4b76-85bb-f87c4ea96a73 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.138168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.138792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.139146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.139444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.139574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.139767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] PATH_INFO: `/v3/users/ba6de03243bf40dabe41be51865fbe8f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.139871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.140014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.140697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.140884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba6de03243bf40dabe41be51865fbe8f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.142616 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.142798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.163719 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1248/2481] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:56 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:56.168135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.178094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a855a42-63aa-4e7d-88c9-d619269b4ddb admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.182777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.183566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.183852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.184126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.184847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.186507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.192818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba6de03243bf40dabe41be51865fbe8f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.196532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1249/2482] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:56.200880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.201352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba6de03243bf40dabe41be51865fbe8f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.202032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba6de03243bf40dabe41be51865fbe8f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.202654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba6de03243bf40dabe41be51865fbe8f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.206045 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:56.211178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f3f1e-c38b-47c9-9beb-c1ca87c662d5 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.215474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba6de03243bf40dabe41be51865fbe8f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.217015 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.217892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.218175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.218464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] PATH_INFO: `/v3/projects/a69cdd9f5d47459a953b7fc98c0a8483/users/7f7a87347c424b57b145339e8c4fef43/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.228048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1234/2483] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:56 2022] DELETE /identity/v3/users/ba6de03243bf40dabe41be51865fbe8f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:56.233374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69cdd9f5d47459a953b7fc98c0a8483, user_id=7f7a87347c424b57b145339e8c4fef43, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.236113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.249368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1250/2484] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:56 2022] PUT /identity/v3/projects/a69cdd9f5d47459a953b7fc98c0a8483/users/7f7a87347c424b57b145339e8c4fef43/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:56.254643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.256242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.293344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:56.326397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d069f1-3887-4403-9ab8-b39f4f0c9248 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.389004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9d42d-65a7-4a85-8ab5-b91655ae1010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.389718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d42d-65a7-4a85-8ab5-b91655ae1010 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.390052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d42d-65a7-4a85-8ab5-b91655ae1010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.390331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9d42d-65a7-4a85-8ab5-b91655ae1010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.391069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d42d-65a7-4a85-8ab5-b91655ae1010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.392756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9d42d-65a7-4a85-8ab5-b91655ae1010 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.402985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1235/2485] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:56.407199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.417855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141395f-0f03-4c20-b80e-b7515864ee27 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.422522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.423559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.423840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.424114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] PATH_INFO: `/v3/projects/a69cdd9f5d47459a953b7fc98c0a8483/users/7f7a87347c424b57b145339e8c4fef43/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.426063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69cdd9f5d47459a953b7fc98c0a8483, user_id=7f7a87347c424b57b145339e8c4fef43, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.428815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.439234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1251/2486] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:56 2022] PUT /identity/v3/projects/a69cdd9f5d47459a953b7fc98c0a8483/users/7f7a87347c424b57b145339e8c4fef43/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:56.449523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.449813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.450096 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.477501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] MFA Rules not processed for user `7f7a87347c424b57b145339e8c4fef43`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:56.478801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.505865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.508095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.555129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1236/2487] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:56.566655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.568076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.589974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bdf59-7bb9-4a2b-99e9-e705c4079594 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.594795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.595682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.595961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.596232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] PATH_INFO: `/v3/projects/bef8b2d702734d3db0ebe648e9d5248f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.597528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef8b2d702734d3db0ebe648e9d5248f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.599465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.628279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abee71-dc82-4f0d-bb9b-61b14d76bf6a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.632516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.633195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.633475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.633753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.635844 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.647267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef8b2d702734d3db0ebe648e9d5248f', 'request_id': 'req-7c8860f2-2375-4b04-85bf-d085e20498f0'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.649965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:56.653693 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef8b2d702734d3db0ebe648e9d5248f', 'request_id': 'req-7c8860f2-2375-4b04-85bf-d085e20498f0'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.659643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef8b2d702734d3db0ebe648e9d5248f', 'request_id': 'req-7c8860f2-2375-4b04-85bf-d085e20498f0'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.673612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] The token cache is being invalidate because project bef8b2d702734d3db0ebe648e9d5248f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:56.673900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.674526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7c8860f2-2375-4b04-85bf-d085e20498f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:56.676117 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1252/2488] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:56 2022] DELETE /identity/v3/projects/bef8b2d702734d3db0ebe648e9d5248f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:56.680847 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.681127 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.681399 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.699769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:56.700931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.701527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.703039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08a8e8-6e1c-4cc0-9c4e-20ce316617ac service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.712676 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1237/2489] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:52:56.751354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:56.764566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1253/2490] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:52:56.772519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.773000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.773107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.792146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:56.793329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:56.801646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1238/2491] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:56.805649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.815401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab14e71-912a-48f8-88d2-0960eff9c2e6 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.820022 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.820680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.820962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.821237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.821957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:56.822273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.823918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.837718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1254/2492] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:52:56.842139 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.852171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5313d-8243-4422-8975-c2703c5702e7 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.857422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.858172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.858519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.858860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.859657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.861592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:56.899334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1239/2493] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:56 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:56.901113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:56.911811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7080a-34ab-47c3-82ee-d5504c1488a7 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:56.982630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:56.983241 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:56.983745 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:56.984034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:56.986359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:56.988913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.016844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1255/2494] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:56 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:52:57.020989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.035071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8bfc6-0a18-4d8b-aee0-29263ec009a4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.043796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.045072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.046129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.047023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.048041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.049889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.067535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1240/2495] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:57.071315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.089587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f59a9-b280-4fdb-bd78-6d80f1f8631c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.097682 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1677adf-8ce5-4e34-b1f6-8dc8a81e69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.098364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1677adf-8ce5-4e34-b1f6-8dc8a81e69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.098650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1677adf-8ce5-4e34-b1f6-8dc8a81e69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.099077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1677adf-8ce5-4e34-b1f6-8dc8a81e69d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.099707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1677adf-8ce5-4e34-b1f6-8dc8a81e69d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.101320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1677adf-8ce5-4e34-b1f6-8dc8a81e69d4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.112922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1256/2496] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:57.117746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.128599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f76e5-46c5-461e-81bc-145f7c1a5018 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.133250 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.134143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.134421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.134690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] PATH_INFO: `/v3/projects/9e3702caaa694a179fee043ef09a427c/users/955e4070d27d45e2bd7dc4f2e8c97acc/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.149959 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3702caaa694a179fee043ef09a427c, user_id=955e4070d27d45e2bd7dc4f2e8c97acc, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.152690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.167616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1241/2497] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:57 2022] PUT /identity/v3/projects/9e3702caaa694a179fee043ef09a427c/users/955e4070d27d45e2bd7dc4f2e8c97acc/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:52:57.182000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.182354 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.182683 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.212723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] MFA Rules not processed for user `955e4070d27d45e2bd7dc4f2e8c97acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:57.213937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:57.286818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1257/2498] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:57.292092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.354243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d899f9e-651f-42b3-a01b-a41d9d085e82 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.359718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.360369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.360641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.360926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.361613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.363579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.398883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1242/2499] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:57 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:57.403116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.415012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565ef49-5493-4eb8-a7cf-4de614006270 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.464635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:57.476362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.477076 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.477357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.477633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.478286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.483195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.501104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1258/2500] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:57 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:57.505203 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.516060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf26be-f341-4b1a-aa34-49d275ef1adf admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.521291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.522015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.522300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.522571 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.523386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.525021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.536255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1243/2501] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:57.540768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.551287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a6b9b-585e-4870-8d57-4f892cad822e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.557210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.558237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.558496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.558782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] PATH_INFO: `/v3/projects/51b42e3c2f64422cb26c5c0df2e6579a/users/02b5677745574488b9be023d93b3f951/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.574319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b42e3c2f64422cb26c5c0df2e6579a, user_id=02b5677745574488b9be023d93b3f951, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.577208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.592632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1259/2502] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:57 2022] PUT /identity/v3/projects/51b42e3c2f64422cb26c5c0df2e6579a/users/02b5677745574488b9be023d93b3f951/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:57.596694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.607251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ee125-036d-46d2-a92b-d6d2af6b627f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.638188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:57.674899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882b32c-a9cd-4806-9e2f-b1372eba34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.675607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882b32c-a9cd-4806-9e2f-b1372eba34e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.675889 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882b32c-a9cd-4806-9e2f-b1372eba34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.676160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882b32c-a9cd-4806-9e2f-b1372eba34e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.676875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882b32c-a9cd-4806-9e2f-b1372eba34e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.678507 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882b32c-a9cd-4806-9e2f-b1372eba34e3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.688722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1244/2503] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:57.692990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.703379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2384e-61d9-4f73-aa32-a460e9bfd524 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.708112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.708973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.709275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.709547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] PATH_INFO: `/v3/projects/51b42e3c2f64422cb26c5c0df2e6579a/users/02b5677745574488b9be023d93b3f951/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.711535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b42e3c2f64422cb26c5c0df2e6579a, user_id=02b5677745574488b9be023d93b3f951, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.714211 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.725202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1260/2504] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:57 2022] PUT /identity/v3/projects/51b42e3c2f64422cb26c5c0df2e6579a/users/02b5677745574488b9be023d93b3f951/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:57.735345 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.735644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.735924 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.763618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] MFA Rules not processed for user `02b5677745574488b9be023d93b3f951`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:57.764824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:57.834501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1245/2505] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:57.845798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:57.847892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:57.904203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c9c1e-4b49-4732-97e2-799b60272334 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:57.908053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e4a1c-e890-4747-bbff-4ef15d54e525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:57.908695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4a1c-e890-4747-bbff-4ef15d54e525 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:57.908979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4a1c-e890-4747-bbff-4ef15d54e525 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:57.909253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4a1c-e890-4747-bbff-4ef15d54e525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:57.919925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e4a1c-e890-4747-bbff-4ef15d54e525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:57.921391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e4a1c-e890-4747-bbff-4ef15d54e525 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:57.933026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1261/2506] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:58.068214 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:58.139521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4cbf6e-f5d5-40ac-b17a-3ece84944df8 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:58.144169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:58.145049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:58.145330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:58.145599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] PATH_INFO: `/v3/users/955e4070d27d45e2bd7dc4f2e8c97acc` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:58.146794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955e4070d27d45e2bd7dc4f2e8c97acc)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:58.148767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:58.197181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955e4070d27d45e2bd7dc4f2e8c97acc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.199920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:58.206230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955e4070d27d45e2bd7dc4f2e8c97acc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.207077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955e4070d27d45e2bd7dc4f2e8c97acc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.208036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955e4070d27d45e2bd7dc4f2e8c97acc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.222176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955e4070d27d45e2bd7dc4f2e8c97acc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.235178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1246/2507] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:58 2022] DELETE /identity/v3/users/955e4070d27d45e2bd7dc4f2e8c97acc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:58.239635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:58.239932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:58.240215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:58.257768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:58.259340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:58.339533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1262/2508] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:58.349150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:58.350936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:58.416593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e3ae-954c-4cea-ad80-68bb48131375 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:58.421106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:58.421751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:58.422029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:58.422300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:58.432536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:58.433974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:58.444367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1247/2509] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:52:58.712977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:58.714564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:58.728840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacba80-8f15-4099-b9b3-629b54fa1f82 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:58.734303 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:58.735941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:58.736585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:58.736859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] PATH_INFO: `/v3/projects/9e3702caaa694a179fee043ef09a427c` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:58.738164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3702caaa694a179fee043ef09a427c)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:58.740139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:58.784039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:58.791631 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3702caaa694a179fee043ef09a427c', 'request_id': 'req-806b37de-4c68-4044-affc-83b08b58fa73'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.798675 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3702caaa694a179fee043ef09a427c', 'request_id': 'req-806b37de-4c68-4044-affc-83b08b58fa73'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.804307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3702caaa694a179fee043ef09a427c', 'request_id': 'req-806b37de-4c68-4044-affc-83b08b58fa73'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.818641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] The token cache is being invalidate because project 9e3702caaa694a179fee043ef09a427c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:58.818928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.819583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.821137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1263/2510] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:58 2022] DELETE /identity/v3/projects/9e3702caaa694a179fee043ef09a427c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:58.825319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:58.834895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6e0b2-c366-4e48-bdce-03e3382aa056 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:58.894592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:58.895513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:58.895794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:58.896050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] PATH_INFO: `/v3/users/02b5677745574488b9be023d93b3f951` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:58.897267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b5677745574488b9be023d93b3f951)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:58.899296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:58.949886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b5677745574488b9be023d93b3f951'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.959085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b5677745574488b9be023d93b3f951'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.959645 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b5677745574488b9be023d93b3f951'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.960497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b5677745574488b9be023d93b3f951'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.973164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6201859f-dae1-4d9a-89d2-7b51543e6eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b5677745574488b9be023d93b3f951'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:58.974435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:58.988876 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1248/2511] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:52:58 2022] DELETE /identity/v3/users/02b5677745574488b9be023d93b3f951 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:59.269846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.271466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:59.288060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b37de-4c68-4044-affc-83b08b58fa73 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.351210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.352320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.352612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.353018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] PATH_INFO: `/v3/projects/51b42e3c2f64422cb26c5c0df2e6579a` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.354364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b42e3c2f64422cb26c5c0df2e6579a)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.356445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.406864 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b42e3c2f64422cb26c5c0df2e6579a', 'request_id': 'req-24e2ed16-3773-448f-b10d-47583d9d9137'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:59.413304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b42e3c2f64422cb26c5c0df2e6579a', 'request_id': 'req-24e2ed16-3773-448f-b10d-47583d9d9137'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:59.419372 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b42e3c2f64422cb26c5c0df2e6579a', 'request_id': 'req-24e2ed16-3773-448f-b10d-47583d9d9137'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:59.432752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] The token cache is being invalidate because project 51b42e3c2f64422cb26c5c0df2e6579a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:52:59.433042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:59.433705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-24e2ed16-3773-448f-b10d-47583d9d9137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:52:59.435342 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1264/2512] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:52:59 2022] DELETE /identity/v3/projects/51b42e3c2f64422cb26c5c0df2e6579a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:59.440630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.440916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.441188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.459615 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:59.460869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:59.521556 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1249/2513] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:59.532353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.532642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.532915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.552586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:59.553795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:52:59.563091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1265/2514] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:52:59.567480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.582583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727e791-0af6-4d7a-9ba4-feedb6dcfa2c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.591200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.592295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.592767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.593237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.594584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:52:59.595106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.597454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.612185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1250/2515] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:52:59.618382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.633348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1041a9-c728-4edd-8635-e36996407694 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.641041 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.641706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.641988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.642258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.642957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.644913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.674266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1266/2516] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:52:59 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:59.679040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.691198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25210ed0-0e94-4a32-8a4b-a155a7c220dd admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.754787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.755679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.756082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.756470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.757530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.760689 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.784935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1251/2517] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:52:59 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:52:59.789477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.800050 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4da5d-df10-403d-b975-686a192c6674 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.805244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.805911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.806191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.806461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.807184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.808825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.820047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1267/2518] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:59.824297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.834501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea5b11-90f0-4af0-b607-3ef3d868e5a4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.839440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75979ba-c86c-48b6-8e5f-ae16a2431991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.840092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75979ba-c86c-48b6-8e5f-ae16a2431991 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.840369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75979ba-c86c-48b6-8e5f-ae16a2431991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.840639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75979ba-c86c-48b6-8e5f-ae16a2431991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.841334 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75979ba-c86c-48b6-8e5f-ae16a2431991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.842939 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75979ba-c86c-48b6-8e5f-ae16a2431991 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.853114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1252/2519] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:52:59.857424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:52:59.867560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4bb45-d47f-4fbc-bc1c-7ae5a9774a7c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:52:59.872915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:52:59.873783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.874075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.874349 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] PATH_INFO: `/v3/projects/59176838bd114eb591fae07223a72edb/users/9bfc313bd93648f39298c61c9797171c/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.890290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59176838bd114eb591fae07223a72edb, user_id=9bfc313bd93648f39298c61c9797171c, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:52:59.893056 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:52:59.896152 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:52:59.911988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1268/2520] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:52:59 2022] PUT /identity/v3/projects/59176838bd114eb591fae07223a72edb/users/9bfc313bd93648f39298c61c9797171c/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:52:59.923573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:52:59.923867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:52:59.924147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:52:59.952450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] MFA Rules not processed for user `9bfc313bd93648f39298c61c9797171c`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:52:59.953674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:00.010539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:00.038646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1253/2521] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:00.043526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.109689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835224c-7434-4acc-9689-f410489b2083 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.114576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.115317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.115552 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.115893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.116569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.118452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.153496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1269/2522] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:00 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:00.158032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.170985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a5cd2-ff4d-4203-8a43-ce8eb0fc6f1d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.230279 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.230963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.231286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.231544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.232240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.234229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.254711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1254/2523] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:00 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:00.260328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.271790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe15b0c-b9dd-45a8-ade1-918084ee82bc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.278040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.278990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.279384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.279640 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.280360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.281960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.293411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1270/2524] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:00.297719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.308541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195beba3-8b8a-4b9d-974e-5d1533ec035e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.314679 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.315646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.315956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.316199 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] PATH_INFO: `/v3/projects/1c15a82f00004261b7306b2b80680918/users/ef2d5e2e18b44ef2ba398c44be3ebadf/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.332495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c15a82f00004261b7306b2b80680918, user_id=ef2d5e2e18b44ef2ba398c44be3ebadf, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.335211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.352805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1255/2525] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:00 2022] PUT /identity/v3/projects/1c15a82f00004261b7306b2b80680918/users/ef2d5e2e18b44ef2ba398c44be3ebadf/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:00.354121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.373191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afab456-cc70-4952-a1d5-b74f3731b7ec admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.436788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b93e5-58bf-49ba-b2c5-459b077e3051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.437457 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b93e5-58bf-49ba-b2c5-459b077e3051 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.437742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b93e5-58bf-49ba-b2c5-459b077e3051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.438016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b93e5-58bf-49ba-b2c5-459b077e3051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.438738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b93e5-58bf-49ba-b2c5-459b077e3051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.440464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b93e5-58bf-49ba-b2c5-459b077e3051 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.451756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1271/2526] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:00.456740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.473855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07d000-188a-41e7-a349-70c4e10c06e6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.480141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.481065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.481348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.481626 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] PATH_INFO: `/v3/projects/1c15a82f00004261b7306b2b80680918/users/ef2d5e2e18b44ef2ba398c44be3ebadf/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.483952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c15a82f00004261b7306b2b80680918, user_id=ef2d5e2e18b44ef2ba398c44be3ebadf, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.486640 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.497724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1256/2527] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:00 2022] PUT /identity/v3/projects/1c15a82f00004261b7306b2b80680918/users/ef2d5e2e18b44ef2ba398c44be3ebadf/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:00.507937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.508231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.508505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.537508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] MFA Rules not processed for user `ef2d5e2e18b44ef2ba398c44be3ebadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:00.538736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:00.591225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:00.611184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1272/2528] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:00.624476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:00.626399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:00.686041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7b116-8487-4d0b-a92f-fc10494e631b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:00.689933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fa297-fcf1-45c5-8836-fd6c86cbdcda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:00.690565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa297-fcf1-45c5-8836-fd6c86cbdcda service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:00.690846 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa297-fcf1-45c5-8836-fd6c86cbdcda service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:00.691113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fa297-fcf1-45c5-8836-fd6c86cbdcda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:00.701388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fa297-fcf1-45c5-8836-fd6c86cbdcda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:00.702842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fa297-fcf1-45c5-8836-fd6c86cbdcda service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:00.712789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1257/2529] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:01.135474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:01.203301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fd819-643a-4a41-b146-45ee777697b3 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:01.208181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:01.209062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:01.209348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:01.209623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] PATH_INFO: `/v3/users/9bfc313bd93648f39298c61c9797171c` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:01.210816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bfc313bd93648f39298c61c9797171c)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:01.212792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:01.259548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bfc313bd93648f39298c61c9797171c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.260195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bfc313bd93648f39298c61c9797171c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.260790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bfc313bd93648f39298c61c9797171c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.268891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bfc313bd93648f39298c61c9797171c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.284308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bfc313bd93648f39298c61c9797171c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.300821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1273/2530] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:01 2022] DELETE /identity/v3/users/9bfc313bd93648f39298c61c9797171c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:01.305513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:01.305990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:01.306202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:01.324933 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:01.326161 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:01.366013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:01.395367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1258/2531] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:01.409229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:01.410584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:01.470199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2ab6e-a457-44a3-898b-a6a6557e0b88 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:01.474072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:01.474720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:01.474999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:01.475322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:01.485360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:01.486798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:01.496332 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1274/2532] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:01.774169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:01.775637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:01.788693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac87391-002a-439d-9f71-12a022f945c6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:01.795774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:01.796560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:01.796815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:01.797087 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] PATH_INFO: `/v3/projects/59176838bd114eb591fae07223a72edb` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:01.798350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59176838bd114eb591fae07223a72edb)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:01.800258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:01.847551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59176838bd114eb591fae07223a72edb', 'request_id': 'req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.853723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59176838bd114eb591fae07223a72edb', 'request_id': 'req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.860182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59176838bd114eb591fae07223a72edb', 'request_id': 'req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.876131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] The token cache is being invalidate because project 59176838bd114eb591fae07223a72edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:01.876412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.877091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:01.878681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1259/2533] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:01 2022] DELETE /identity/v3/projects/59176838bd114eb591fae07223a72edb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:01.882893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:01.892607 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79f2a-dd43-46c4-bcb0-d0c07d4f9011 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:01.901813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:01.956768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:01.957665 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:01.957947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:01.958216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] PATH_INFO: `/v3/users/ef2d5e2e18b44ef2ba398c44be3ebadf` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:01.959560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2d5e2e18b44ef2ba398c44be3ebadf)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:01.961563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.011576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2d5e2e18b44ef2ba398c44be3ebadf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.012278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2d5e2e18b44ef2ba398c44be3ebadf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.012948 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2d5e2e18b44ef2ba398c44be3ebadf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.022317 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2d5e2e18b44ef2ba398c44be3ebadf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.035811 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3156f228-50f0-46f8-b2bb-835cc334dc0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2d5e2e18b44ef2ba398c44be3ebadf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.048390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1275/2534] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:01 2022] DELETE /identity/v3/users/ef2d5e2e18b44ef2ba398c44be3ebadf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:02.325520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.327284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:02.343499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfc17-4df7-420e-b9ea-3b55e855bf0a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.414534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.416113 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.417807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.417807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] PATH_INFO: `/v3/projects/1c15a82f00004261b7306b2b80680918` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.418034 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c15a82f00004261b7306b2b80680918)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:02.420110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.473413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c15a82f00004261b7306b2b80680918', 'request_id': 'req-c9582456-8821-4c58-8039-70dcf0c434eb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.479686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c15a82f00004261b7306b2b80680918', 'request_id': 'req-c9582456-8821-4c58-8039-70dcf0c434eb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.485441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c15a82f00004261b7306b2b80680918', 'request_id': 'req-c9582456-8821-4c58-8039-70dcf0c434eb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.487967 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:02.500130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] The token cache is being invalidate because project 1c15a82f00004261b7306b2b80680918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:02.500413 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.501010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c9582456-8821-4c58-8039-70dcf0c434eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:02.502559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1260/2535] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:02 2022] DELETE /identity/v3/projects/1c15a82f00004261b7306b2b80680918 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:02.508526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.508996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.509097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.526736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:02.527969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:02.590766 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1276/2536] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:02.650804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.651572 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.652183 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.682454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:02.684604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:02.696301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1261/2537] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:02.701597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.716751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0852d7-4046-4d4f-8051-d77f0522aec0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.722586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.723286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.723567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.723836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.724589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:02.724898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:02.726617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.739824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1277/2538] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:02.744367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.754177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081858bb-f9c7-4ea9-94a2-cd3136a5d5e2 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.759513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.760168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.760458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.760723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.761415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:02.763388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.790088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1262/2539] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:02 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:02.794246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.804717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774cf29-4d75-4b42-8faf-3428227ec7e3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.823187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:02.867459 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.868112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.868392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.868667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.869370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:02.871389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.891496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1278/2540] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:02 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:02.895663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.907499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343eef55-28f0-44e8-aeb7-8fc4760b2d7b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.912781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.913437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.913729 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.913994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.914696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:02.916348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.926685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1263/2541] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:02.930905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.941582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9f9d-c36b-457e-ad89-8f7358fe0e3d admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.947519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c1f01-9fe2-4457-b467-3cea2b8a5bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.948520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1f01-9fe2-4457-b467-3cea2b8a5bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.948807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1f01-9fe2-4457-b467-3cea2b8a5bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.949080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1f01-9fe2-4457-b467-3cea2b8a5bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.949829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c1f01-9fe2-4457-b467-3cea2b8a5bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:02.951539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c1f01-9fe2-4457-b467-3cea2b8a5bdf admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:02.962062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1279/2542] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:02.966127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:02.976099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae727b-fad2-48f1-90d1-4b238d208eb1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:02.981144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:02.982023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:02.982322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:02.982593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] PATH_INFO: `/v3/projects/a35b3b32ac7f454c9e43f15d43f1a879/users/c99158cbb17a477bb5ea3ab652e66fe7/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:02.997610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35b3b32ac7f454c9e43f15d43f1a879, user_id=c99158cbb17a477bb5ea3ab652e66fe7, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:03.000341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:03.015415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1264/2543] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:02 2022] PUT /identity/v3/projects/a35b3b32ac7f454c9e43f15d43f1a879/users/c99158cbb17a477bb5ea3ab652e66fe7/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:03.025563 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.025870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.026150 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.053633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] MFA Rules not processed for user `c99158cbb17a477bb5ea3ab652e66fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:03.054859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.125779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1280/2544] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:03.137188 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:03.138956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.201562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff56554-79a4-417a-b3b3-ea3e25edfce0 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:03.205260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fc9c6-515e-4dac-936b-046fddf15b53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:03.205893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fc9c6-515e-4dac-936b-046fddf15b53 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.206169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fc9c6-515e-4dac-936b-046fddf15b53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.206442 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fc9c6-515e-4dac-936b-046fddf15b53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.215058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fc9c6-515e-4dac-936b-046fddf15b53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:03.216545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fc9c6-515e-4dac-936b-046fddf15b53 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:03.225561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1265/2545] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:03.245564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:03.312968 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a9c89-475e-44e0-9107-79e7d05249b5 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:03.318532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:03.319464 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.319743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.320094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] PATH_INFO: `/v3/users/c99158cbb17a477bb5ea3ab652e66fe7` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.321242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99158cbb17a477bb5ea3ab652e66fe7)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:03.323179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:03.360654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:03.375980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99158cbb17a477bb5ea3ab652e66fe7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.376633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99158cbb17a477bb5ea3ab652e66fe7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.377232 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99158cbb17a477bb5ea3ab652e66fe7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.386678 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99158cbb17a477bb5ea3ab652e66fe7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.399740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99158cbb17a477bb5ea3ab652e66fe7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.411785 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1281/2546] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:03 2022] DELETE /identity/v3/users/c99158cbb17a477bb5ea3ab652e66fe7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:03.416878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.417387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.417387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.435713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:03.437009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.468340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:03.469809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.506717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1266/2547] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:03.516601 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:03.518067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.527306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8be90-cc60-4581-b13b-6b0da439056a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:03.530985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:03.531660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.531941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.532213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.533949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.553863 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:03.577166 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6052847-ca54-4a39-9437-fcf601faecf4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:03.580968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:03.581591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.581867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.582120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.591168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:03.592644 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:03.597118 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:03.598790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701d5bc-3c02-408b-942a-d467f4b2b348 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:03.602105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1267/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:53:03.609964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1282/2549] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:03.888220 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:03.889927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:03.906008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a021878-3f22-42ca-b7cf-43ff52fcd990 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:03.914224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:03.916064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:03.916382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:03.916658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] PATH_INFO: `/v3/projects/a35b3b32ac7f454c9e43f15d43f1a879` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:03.918930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35b3b32ac7f454c9e43f15d43f1a879)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:03.921153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:03.982465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35b3b32ac7f454c9e43f15d43f1a879', 'request_id': 'req-2c938216-d222-4828-b7fd-e80146c9875f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.989019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35b3b32ac7f454c9e43f15d43f1a879', 'request_id': 'req-2c938216-d222-4828-b7fd-e80146c9875f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:03.994858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35b3b32ac7f454c9e43f15d43f1a879', 'request_id': 'req-2c938216-d222-4828-b7fd-e80146c9875f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:04.008667 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] The token cache is being invalidate because project a35b3b32ac7f454c9e43f15d43f1a879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:04.009009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:04.009709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-2c938216-d222-4828-b7fd-e80146c9875f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:04.011358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1268/2550] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:03 2022] DELETE /identity/v3/projects/a35b3b32ac7f454c9e43f15d43f1a879 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:04.016485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.016775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.017052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.035088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:04.036320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:04.089500 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:04.100973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1283/2551] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:04.109173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.109457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.109731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.129643 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:04.130936 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:04.141648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1269/2552] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:04.146959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.161793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6e5d8-c835-45bf-a3c8-5640c7c2cb12 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.168720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.169425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.169680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.170008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.170718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:04.171019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.172674 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.185053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1284/2553] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:04.189543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.199414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9cc27-c82b-4152-9c53-82ea48447e85 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.205656 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.206246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.206534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.206806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.207574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.209574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.238287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1270/2554] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:04.243673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.253927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d50491-c467-40d6-a7b0-cc622f6eaeb4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.311863 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.312557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.312840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.313120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.313800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.315793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.338769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1285/2555] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:04.342289 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.352609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c183a30-9302-4e61-a66d-61e9a2ee440d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.357371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.358038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.358320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.358597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.359346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.360958 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.372853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1271/2556] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:53:04.376956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.389661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56d5d9-e9fc-4c5a-aafd-0047a6fe72ac admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.393560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c35dd-5669-49db-a438-dea8ead14016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.394263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c35dd-5669-49db-a438-dea8ead14016 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.394547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c35dd-5669-49db-a438-dea8ead14016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.394826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c35dd-5669-49db-a438-dea8ead14016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.395595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c35dd-5669-49db-a438-dea8ead14016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.397213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c35dd-5669-49db-a438-dea8ead14016 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.407837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1286/2557] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:04.411784 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.422451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37de32-ce8e-4fa7-b263-9b0fc31a0fa1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.427211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.428560 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.428838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.429111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] PATH_INFO: `/v3/projects/ec434df9ab844ee58d2d2708e0fecee4/users/658c72d4459149b7b1dd83d2d844775b/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.446806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec434df9ab844ee58d2d2708e0fecee4, user_id=658c72d4459149b7b1dd83d2d844775b, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.451170 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.466277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1272/2558] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:04 2022] PUT /identity/v3/projects/ec434df9ab844ee58d2d2708e0fecee4/users/658c72d4459149b7b1dd83d2d844775b/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:04.478445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.478742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.478991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.506809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] MFA Rules not processed for user `658c72d4459149b7b1dd83d2d844775b`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:04.508084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:04.573378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1287/2559] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:04.578344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.640697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:04.647062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1e4c2-70eb-4848-9704-010d81527e99 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.653241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.653902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.654235 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.654505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.655184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.657131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.684039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1273/2560] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:04.688501 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.699330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f062fad-cd83-41e7-8c7b-ad78ac53d3eb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.745689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:04.755626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.756299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.756580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.756855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.757550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.759528 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.779885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1288/2561] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:04 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:04.784036 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.794458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bdf089-7555-412a-a741-35314abec879 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.799463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.800115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.800399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.800671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.801399 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.803000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.813610 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1274/2562] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:04.817656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.828734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7376-9630-44ae-91c5-a62a1a832226 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.834269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.835145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.835450 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.835721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] PATH_INFO: `/v3/projects/c85116a971d44439975b6c55db4a4e14/users/5ab00f4f25214e1bbe4797d385137693/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.851206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85116a971d44439975b6c55db4a4e14, user_id=5ab00f4f25214e1bbe4797d385137693, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.853896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.868274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1289/2563] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:04 2022] PUT /identity/v3/projects/c85116a971d44439975b6c55db4a4e14/users/5ab00f4f25214e1bbe4797d385137693/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:04.872506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.882583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696e1fb-e288-45b8-a2a9-10e071b2e7c7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.945852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c868fd-caa5-4049-868b-1ae9bc62ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.946589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c868fd-caa5-4049-868b-1ae9bc62ebff admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.946865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c868fd-caa5-4049-868b-1ae9bc62ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.947138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c868fd-caa5-4049-868b-1ae9bc62ebff admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.947884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c868fd-caa5-4049-868b-1ae9bc62ebff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.949540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c868fd-caa5-4049-868b-1ae9bc62ebff admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.959653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1275/2564] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:04.963942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:04.974961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123db964-607b-41b9-aba3-24772b93b851 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:04.980188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:04.981077 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:04.981353 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:04.981619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] PATH_INFO: `/v3/projects/c85116a971d44439975b6c55db4a4e14/users/5ab00f4f25214e1bbe4797d385137693/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:04.983973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85116a971d44439975b6c55db4a4e14, user_id=5ab00f4f25214e1bbe4797d385137693, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:04.986713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:04.997108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1290/2565] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:04 2022] PUT /identity/v3/projects/c85116a971d44439975b6c55db4a4e14/users/5ab00f4f25214e1bbe4797d385137693/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:05.007071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:05.007390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:05.007664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:05.033808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] MFA Rules not processed for user `5ab00f4f25214e1bbe4797d385137693`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:05.034993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:05.105999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1276/2566] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:05.117037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:05.118816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:05.177394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40adbc-29e0-48da-9bf0-4ca2eed52b4c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:05.181749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006d00b-bf3e-4a97-b5da-06028928bb7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:05.182384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006d00b-bf3e-4a97-b5da-06028928bb7e service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:05.182664 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006d00b-bf3e-4a97-b5da-06028928bb7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:05.182945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006d00b-bf3e-4a97-b5da-06028928bb7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:05.240280 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006d00b-bf3e-4a97-b5da-06028928bb7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:05.241647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006d00b-bf3e-4a97-b5da-06028928bb7e service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:05.250758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1291/2567] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:10.969258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:11.027713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:11.041668 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f7b4e-c186-42e3-ac0c-2a3234f3d5a6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:11.047489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:11.048514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:11.048795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:11.049061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] PATH_INFO: `/v3/users/658c72d4459149b7b1dd83d2d844775b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:11.050232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658c72d4459149b7b1dd83d2d844775b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:11.052265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:11.103359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658c72d4459149b7b1dd83d2d844775b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.112629 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658c72d4459149b7b1dd83d2d844775b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.113264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658c72d4459149b7b1dd83d2d844775b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.114007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658c72d4459149b7b1dd83d2d844775b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.126883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658c72d4459149b7b1dd83d2d844775b'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.139100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1277/2568] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:10 2022] DELETE /identity/v3/users/658c72d4459149b7b1dd83d2d844775b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:11.143833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:11.144330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:11.144463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:11.162805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:11.164040 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:11.216139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:11.228168 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1292/2569] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:53:11.235331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:11.237546 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:11.301366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c12d2-ddc7-4ac8-8720-884c823f7be5 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:11.306877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:11.307802 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:11.308119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:11.308461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:11.320489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:11.321943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:11.331746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1278/2570] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:11.614078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:11.615915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:11.642487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898387b-8f92-4ee2-a55a-7e63f0404386 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:11.648137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:11.649018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:11.649305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:11.649584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] PATH_INFO: `/v3/projects/ec434df9ab844ee58d2d2708e0fecee4` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:11.650775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec434df9ab844ee58d2d2708e0fecee4)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:11.652759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:11.702210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec434df9ab844ee58d2d2708e0fecee4', 'request_id': 'req-76412aae-54ec-4682-af4a-0882a3b210e3'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.708663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec434df9ab844ee58d2d2708e0fecee4', 'request_id': 'req-76412aae-54ec-4682-af4a-0882a3b210e3'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.714584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec434df9ab844ee58d2d2708e0fecee4', 'request_id': 'req-76412aae-54ec-4682-af4a-0882a3b210e3'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.728671 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] The token cache is being invalidate because project ec434df9ab844ee58d2d2708e0fecee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:11.728889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.729569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.731214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1293/2571] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:11 2022] DELETE /identity/v3/projects/ec434df9ab844ee58d2d2708e0fecee4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:11.735715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:11.745872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fa948-5dd3-405b-899c-b5bcde316857 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:11.810381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:11.811305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:11.811589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:11.811853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] PATH_INFO: `/v3/users/5ab00f4f25214e1bbe4797d385137693` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:11.813025 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab00f4f25214e1bbe4797d385137693)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:11.814962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:11.828809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:11.872946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab00f4f25214e1bbe4797d385137693'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.881910 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab00f4f25214e1bbe4797d385137693'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.882564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab00f4f25214e1bbe4797d385137693'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.883246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab00f4f25214e1bbe4797d385137693'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.896159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-d012b8b5-2489-408c-914b-7a7677b07486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab00f4f25214e1bbe4797d385137693'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:11.908976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1279/2572] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:11 2022] DELETE /identity/v3/users/5ab00f4f25214e1bbe4797d385137693 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:12.196751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.198270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:12.211433 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76412aae-54ec-4682-af4a-0882a3b210e3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.270979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.271810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.272095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.272374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] PATH_INFO: `/v3/projects/c85116a971d44439975b6c55db4a4e14` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.273561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85116a971d44439975b6c55db4a4e14)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.275575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.325318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85116a971d44439975b6c55db4a4e14', 'request_id': 'req-022da8c9-28da-487f-b987-e7b46a2d2a51'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:12.331720 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85116a971d44439975b6c55db4a4e14', 'request_id': 'req-022da8c9-28da-487f-b987-e7b46a2d2a51'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:12.337513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85116a971d44439975b6c55db4a4e14', 'request_id': 'req-022da8c9-28da-487f-b987-e7b46a2d2a51'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:12.351741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] The token cache is being invalidate because project c85116a971d44439975b6c55db4a4e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:12.352030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:12.352655 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-022da8c9-28da-487f-b987-e7b46a2d2a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:12.354206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1294/2573] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:12 2022] DELETE /identity/v3/projects/c85116a971d44439975b6c55db4a4e14 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:12.359349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.359851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.359957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.379797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:12.381000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:12.443444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1280/2574] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:12.451605 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.451858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.452164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.470842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:12.472058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:12.482063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1295/2575] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:12.486605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.496588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45d35e-011c-4bd1-a823-2e7d9a0a5d9e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.501536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.502200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.502480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.502749 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.503990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:12.504297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.505909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.518921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1281/2576] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:12.523218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.533401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6347e11-1961-4b04-873f-fa40fb2eabcf None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.539129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.539865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.540185 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.540482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.541173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.543179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.546781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:12.573017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1296/2577] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:12.577742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.588276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c5af-d005-4582-a794-d2c28b27f34c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.648357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.649035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.649333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.649591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.650436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.652404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.678877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1282/2578] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:12 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:12.682916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.694577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551f6181-b924-4a12-b901-98e6819dfaa3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.699764 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.700416 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.700819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.701274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.702000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.703632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.714038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1297/2579] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:53:12.718169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.728744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9ff44-a5d5-4ebf-810d-d663fd2570b2 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.733703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b02cf-290b-46d8-b999-9fa93ca8a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.734452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b02cf-290b-46d8-b999-9fa93ca8a071 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.734737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b02cf-290b-46d8-b999-9fa93ca8a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.735014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b02cf-290b-46d8-b999-9fa93ca8a071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.735777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b02cf-290b-46d8-b999-9fa93ca8a071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.737390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b02cf-290b-46d8-b999-9fa93ca8a071 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.740021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:12.749833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1283/2580] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:12.754591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:12.765352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1801abca-199f-41c4-97f1-59b2f98eed22 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:12.770891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:12.771816 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.772125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.772402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] PATH_INFO: `/v3/projects/536c46ea6974491ba2557e3de1c58876/users/b01274413c804f39b46af16506a8445c/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.790842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c46ea6974491ba2557e3de1c58876, user_id=b01274413c804f39b46af16506a8445c, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:12.793555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:12.807872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1298/2581] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:12 2022] PUT /identity/v3/projects/536c46ea6974491ba2557e3de1c58876/users/b01274413c804f39b46af16506a8445c/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:12.819764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:12.820126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:12.820530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:12.851558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] MFA Rules not processed for user `b01274413c804f39b46af16506a8445c`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:12.852813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:12.928291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1284/2582] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:12.929955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.004187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852cd9-bc70-4129-97ea-31e9730dc933 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.009481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.010538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.012220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.012220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.012220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.013997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.047002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1299/2583] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:12 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:13.050922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.061779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e93571-91dc-48fb-bf89-7215fdfce776 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.119497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.120262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.120581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.120891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.121646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.123671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.146325 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1285/2584] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:13 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:13.150295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.160955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea428dac-60c6-4213-89fe-0fddd79bfaa4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.167010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.167710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.167989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.168249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.168970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.170663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.181444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1300/2585] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:13.185501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.196031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b675b4-b665-4381-bb56-290bf9d8bcf7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.201130 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb750e-4cb0-46e3-b991-c71cb81fbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.201789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb750e-4cb0-46e3-b991-c71cb81fbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.202070 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb750e-4cb0-46e3-b991-c71cb81fbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.202343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb750e-4cb0-46e3-b991-c71cb81fbd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.203062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb750e-4cb0-46e3-b991-c71cb81fbd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.204711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb750e-4cb0-46e3-b991-c71cb81fbd13 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.214820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1286/2586] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:13.218832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.228774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5814a-901d-4db3-9936-cd91c71a273a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.233687 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.234567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.234846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.235120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] PATH_INFO: `/v3/projects/05ce971ce5b54ccfbecde78f70611511/users/9fd9cfeead82498db5b55a85f5db4836/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.250064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ce971ce5b54ccfbecde78f70611511, user_id=9fd9cfeead82498db5b55a85f5db4836, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.252752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.268657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1301/2587] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:13 2022] PUT /identity/v3/projects/05ce971ce5b54ccfbecde78f70611511/users/9fd9cfeead82498db5b55a85f5db4836/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:13.283854 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.284157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.284436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.313092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] MFA Rules not processed for user `9fd9cfeead82498db5b55a85f5db4836`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:13.314230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:13.372331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:13.383614 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1287/2588] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:13.387323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.450485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161fe15-956a-4e88-be74-cf80cf22a829 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.455585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.456234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.456512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.456780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.457472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.459400 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.462901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:13.487972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1302/2589] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:13 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:13.492272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.503531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa7352-ef22-4a9a-9f0f-058bd482937c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.562965 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.563750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.564004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.564311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.565021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.566980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.591659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1288/2590] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:13 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:13.592974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.606509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03620e-80ab-44e1-83ec-445da6752eb6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.613975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.614792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.615184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.615498 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.616667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.618951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.634661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1303/2591] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:53:13.638712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.649201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e89a4e-fce8-4ddd-ab28-90e74cedea88 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.654544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.655714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.656103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.656385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] PATH_INFO: `/v3/projects/b7786c87a4c046e49a87801ee8408ad7/users/b33f1525389941f28ae37e1d5374aff5/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.673217 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7786c87a4c046e49a87801ee8408ad7, user_id=b33f1525389941f28ae37e1d5374aff5, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.675969 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.689771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1289/2592] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:13 2022] PUT /identity/v3/projects/b7786c87a4c046e49a87801ee8408ad7/users/b33f1525389941f28ae37e1d5374aff5/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:13.693882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.708203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb68bae-15d6-4e74-b0e8-c5a52d2ab51f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.770466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f3caf-5ec4-4d15-8158-77c9e8b970d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.771140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3caf-5ec4-4d15-8158-77c9e8b970d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.771451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3caf-5ec4-4d15-8158-77c9e8b970d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.771721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3caf-5ec4-4d15-8158-77c9e8b970d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.772437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3caf-5ec4-4d15-8158-77c9e8b970d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.774044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f3caf-5ec4-4d15-8158-77c9e8b970d1 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.784072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1304/2593] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:13.788707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.802581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffeb0c-d9f2-4cd8-a7ea-b22ba0428b84 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:13.807335 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:13.808234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.808510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.808772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] PATH_INFO: `/v3/projects/b7786c87a4c046e49a87801ee8408ad7/users/b33f1525389941f28ae37e1d5374aff5/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.810754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7786c87a4c046e49a87801ee8408ad7, user_id=b33f1525389941f28ae37e1d5374aff5, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:13.813443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:13.824742 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1290/2594] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:13 2022] PUT /identity/v3/projects/b7786c87a4c046e49a87801ee8408ad7/users/b33f1525389941f28ae37e1d5374aff5/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:13.836551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:13.836959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:13.837237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:13.864761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] MFA Rules not processed for user `b33f1525389941f28ae37e1d5374aff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:13.865978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:13.936672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1305/2595] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:53:13.948736 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:13.950858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:14.012829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a91180-fdf9-4da3-9883-ac4a5e24ca8a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:14.016893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:14.017536 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:14.017818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:14.018089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:14.085502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:14.087006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:14.096810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1291/2596] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:20.891798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:20.901644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cc684-5d9d-4c5f-acac-2d5ffce821eb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:20.905244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:20.905882 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:20.906160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:20.906430 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:20.961151 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:20.965576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:20.967261 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:20.977301 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1306/2597] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:21.545029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:21.549412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:21.555463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d86d81-74b4-4d58-bb94-10754a4b8ca0 service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:21.563468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0293c6a-c2d2-4889-842e-835f444f2a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:21.564115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293c6a-c2d2-4889-842e-835f444f2a7a service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:21.564393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293c6a-c2d2-4889-842e-835f444f2a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:21.564787 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293c6a-c2d2-4889-842e-835f444f2a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:21.574520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0293c6a-c2d2-4889-842e-835f444f2a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:21.576083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0293c6a-c2d2-4889-842e-835f444f2a7a service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:21.586171 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1292/2598] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:22.519378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:22.520978 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:22.588262 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62833c17-f6b8-4233-9ece-a7f5d9d4ae69 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:22.593773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:22.594630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:22.594916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:22.595200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] PATH_INFO: `/v3/users/b0b098bd5c144c1e8d30e5ec671e0d19` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:22.596483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b098bd5c144c1e8d30e5ec671e0d19)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:22.598432 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:22.647256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b098bd5c144c1e8d30e5ec671e0d19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:22.647926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b098bd5c144c1e8d30e5ec671e0d19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:22.648512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b098bd5c144c1e8d30e5ec671e0d19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:22.657222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b098bd5c144c1e8d30e5ec671e0d19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:22.674394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b098bd5c144c1e8d30e5ec671e0d19'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:22.687814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1307/2599] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:22 2022] DELETE /identity/v3/users/b0b098bd5c144c1e8d30e5ec671e0d19 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:22.694517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:22.695046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:22.695046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:22.714344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:22.715574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:22.790825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1293/2600] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:22.800636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:22.802023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:22.864460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc77287-29b2-4aa9-8b63-26a17c23b386 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:22.868757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:22.869440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:22.869714 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:22.869986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:22.880125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:22.881559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:22.891834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1308/2601] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:53:23.182722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:23.184168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:23.199341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16acb0e6-6147-43de-a254-65f06be1c0ce None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:23.205868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:23.206757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:23.207043 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:23.207354 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] PATH_INFO: `/v3/projects/22e6ab2d979a414b8f4c7ee778e58af8` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:23.208823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e6ab2d979a414b8f4c7ee778e58af8)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:23.210750 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:23.266698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e6ab2d979a414b8f4c7ee778e58af8', 'request_id': 'req-42ee5920-7bcc-4ae7-88a3-ec174c649654'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.273338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e6ab2d979a414b8f4c7ee778e58af8', 'request_id': 'req-42ee5920-7bcc-4ae7-88a3-ec174c649654'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.279646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e6ab2d979a414b8f4c7ee778e58af8', 'request_id': 'req-42ee5920-7bcc-4ae7-88a3-ec174c649654'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.292882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] The token cache is being invalidate because project 22e6ab2d979a414b8f4c7ee778e58af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:23.293164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.293773 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.295340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1294/2602] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:23 2022] DELETE /identity/v3/projects/22e6ab2d979a414b8f4c7ee778e58af8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:23.299920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:23.310267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20806a64-a5b7-429b-9bea-ed7657ee378d service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:23.322481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:23.372382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:23.373271 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:23.373550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:23.373826 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] PATH_INFO: `/v3/users/6626da70b0c84df98a0fe990923eb9c7` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:23.375044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6626da70b0c84df98a0fe990923eb9c7)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:23.377097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:23.424895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6626da70b0c84df98a0fe990923eb9c7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.425536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6626da70b0c84df98a0fe990923eb9c7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.426130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6626da70b0c84df98a0fe990923eb9c7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.433135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6626da70b0c84df98a0fe990923eb9c7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.444810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-6de07a77-1cf1-49c3-a437-0f56f8219672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6626da70b0c84df98a0fe990923eb9c7'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.456868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1309/2603] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:23 2022] DELETE /identity/v3/users/6626da70b0c84df98a0fe990923eb9c7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:23.751302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:23.752811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:23.766455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5920-7bcc-4ae7-88a3-ec174c649654 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:23.826569 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:23.827595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:23.827899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:23.828172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] PATH_INFO: `/v3/projects/73dbfbfca4dc41a8a82487b4bad7e4b5` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:23.829351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dbfbfca4dc41a8a82487b4bad7e4b5)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:23.831324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:23.847236 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:23.888514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dbfbfca4dc41a8a82487b4bad7e4b5', 'request_id': 'req-375203f5-81bd-48e8-86da-8f6e6df50f92'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.894551 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dbfbfca4dc41a8a82487b4bad7e4b5', 'request_id': 'req-375203f5-81bd-48e8-86da-8f6e6df50f92'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.900692 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dbfbfca4dc41a8a82487b4bad7e4b5', 'request_id': 'req-375203f5-81bd-48e8-86da-8f6e6df50f92'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.914896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] The token cache is being invalidate because project 73dbfbfca4dc41a8a82487b4bad7e4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:23.915219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.915941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-375203f5-81bd-48e8-86da-8f6e6df50f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:23.917646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1295/2604] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:23 2022] DELETE /identity/v3/projects/73dbfbfca4dc41a8a82487b4bad7e4b5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:23.922842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:23.923493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:23.923493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:23.941925 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:23.943108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:24.011264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1310/2605] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:24.020192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.020587 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.020931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.040818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:24.042014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:24.050353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1296/2606] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:24.054641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.064733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d6b06-c39e-4873-91b2-ffdef64a1d0f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.069649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.070329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.070630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.070919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.071691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:24.072002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.073653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.086273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1311/2607] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:24.090697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.100387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd17c3-33e4-433d-a3c0-a94344d12fe6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.105444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.106112 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.106402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.106737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.107490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.109501 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.140006 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1297/2608] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:24.144274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.154787 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625d440-f401-49ee-9557-8b79ddd73a52 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.174575 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:24.218559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.219265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.219549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.219830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.220530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.222445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.246712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1312/2609] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:24.251748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.264026 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c47ff-72ac-42c9-9bdf-00ee3353f523 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.270439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.271107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.271422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.271696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.272423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.274035 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.287809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1298/2610] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:24.291984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.302345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4057dba-1bbf-4e52-b994-37ac93d96f37 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.308291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f659e-5e4d-490d-8250-e50a0ef2349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.308955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f659e-5e4d-490d-8250-e50a0ef2349d admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.309237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f659e-5e4d-490d-8250-e50a0ef2349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.309526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f659e-5e4d-490d-8250-e50a0ef2349d admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.310321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f659e-5e4d-490d-8250-e50a0ef2349d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.312186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f659e-5e4d-490d-8250-e50a0ef2349d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.322267 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1313/2611] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:24.326342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.336544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600e9a1-872c-463f-9c8d-83c2ae372b57 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.341397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.342292 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.362596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.362596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] PATH_INFO: `/v3/projects/7c4618acb15d4a2f8becc157c6bb21e2/users/72b799f6a05849609e43f35f57f09800/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.363374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c4618acb15d4a2f8becc157c6bb21e2, user_id=72b799f6a05849609e43f35f57f09800, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.372314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.389799 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1299/2612] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:24 2022] PUT /identity/v3/projects/7c4618acb15d4a2f8becc157c6bb21e2/users/72b799f6a05849609e43f35f57f09800/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:24.404324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.404632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.404910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.432621 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] MFA Rules not processed for user `72b799f6a05849609e43f35f57f09800`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:24.433849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:24.497686 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1314/2613] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:24.502201 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.566775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd557e-16ce-4869-a351-dae1b152cb54 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.572339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.572994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.573272 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.573544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.574241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.576273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.604522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1300/2614] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:24.608603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.619171 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd39f9-7088-4361-ac0d-3d0d892d393a None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.676114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.676775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.677057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.677338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.678013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.679966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.702425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1315/2615] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:24.706329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.716653 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eaf2b2-516b-45ae-b90d-f4d1ceaa888c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.722099 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.722758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.723038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.723358 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.724083 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.725727 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.736492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1301/2616] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:24.740511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.750861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9ff18-e51c-4736-ae53-8b0d5bb6955b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.757013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.757926 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.758210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.758487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] PATH_INFO: `/v3/projects/5a20595b4ffa42548b56558a3eb9f43e/users/522cb1c90df741d988d69784a4d6022b/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.780021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a20595b4ffa42548b56558a3eb9f43e, user_id=522cb1c90df741d988d69784a4d6022b, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.782819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.786055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:24.800805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1316/2617] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:24 2022] PUT /identity/v3/projects/5a20595b4ffa42548b56558a3eb9f43e/users/522cb1c90df741d988d69784a4d6022b/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:24.805444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.816066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445505a-80e2-4657-b6ac-24280df88b3f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.825058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:24.878387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fa02c-5868-44ba-b37f-4fd606801b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.879236 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa02c-5868-44ba-b37f-4fd606801b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.879533 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa02c-5868-44ba-b37f-4fd606801b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.879815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fa02c-5868-44ba-b37f-4fd606801b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.880544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fa02c-5868-44ba-b37f-4fd606801b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.882211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fa02c-5868-44ba-b37f-4fd606801b42 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.893086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1302/2618] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:24.897065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:24.907815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47a5f-746e-4127-80c1-4bdc03388c14 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:24.912795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:24.913822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.914107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.914473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] PATH_INFO: `/v3/projects/5a20595b4ffa42548b56558a3eb9f43e/users/522cb1c90df741d988d69784a4d6022b/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.916547 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a20595b4ffa42548b56558a3eb9f43e, user_id=522cb1c90df741d988d69784a4d6022b, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:24.919325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:24.929819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1317/2619] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:24 2022] PUT /identity/v3/projects/5a20595b4ffa42548b56558a3eb9f43e/users/522cb1c90df741d988d69784a4d6022b/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:24.941553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:24.941848 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:24.942160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:24.971901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] MFA Rules not processed for user `522cb1c90df741d988d69784a4d6022b`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:24.973125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:25.042472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1303/2620] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:25.054324 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:25.056184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:25.130007 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a70a6-2258-422e-9184-e629cbb04b7f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:25.134518 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:25.135212 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:25.135499 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:25.135774 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:25.146160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:25.147873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:25.158011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1318/2621] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:25.232620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:25.242119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640e21-1e02-4b47-949b-f558edf99084 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:25.245648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5efc64-4968-4e95-b3bc-6c83525a73e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:25.246286 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5efc64-4968-4e95-b3bc-6c83525a73e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:25.246562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5efc64-4968-4e95-b3bc-6c83525a73e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:25.246829 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5efc64-4968-4e95-b3bc-6c83525a73e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:25.307819 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5efc64-4968-4e95-b3bc-6c83525a73e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:25.309357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5efc64-4968-4e95-b3bc-6c83525a73e7 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:25.318724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1304/2622] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:26.563191 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:26.564825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:26.639018 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821f2d-5009-43d9-8378-5bdaafb95d3b service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:26.644096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:26.644990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:26.645275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:26.645553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] PATH_INFO: `/v3/users/b01274413c804f39b46af16506a8445c` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:26.646762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01274413c804f39b46af16506a8445c)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:26.649092 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:26.700148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01274413c804f39b46af16506a8445c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:26.701142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01274413c804f39b46af16506a8445c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:26.701809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01274413c804f39b46af16506a8445c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:26.711245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01274413c804f39b46af16506a8445c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:26.724578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01274413c804f39b46af16506a8445c'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:26.738048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1319/2623] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:26 2022] DELETE /identity/v3/users/b01274413c804f39b46af16506a8445c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:26.743637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:26.744094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:26.744376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:26.764554 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:26.765670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:26.799511 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=100 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:26.850313 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1305/2624] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:26.856835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:26.858329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:26.864990 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:26.927437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e63b1-4bdb-44c3-b9d8-113076545e35 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:26.931048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:26.931737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:26.932021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:26.932295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:26.941524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:26.942975 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:26.952799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1320/2625] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:27.247144 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:27.248918 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:27.263617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf858777-44e6-47fd-8cf2-877aaa21ae9c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:27.269244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:27.270014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:27.270293 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:27.270624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] PATH_INFO: `/v3/projects/536c46ea6974491ba2557e3de1c58876` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:27.271903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536c46ea6974491ba2557e3de1c58876)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:27.273814 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:27.321834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536c46ea6974491ba2557e3de1c58876', 'request_id': 'req-b6c06068-6c67-4c29-84db-8a10b1cf68d7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.327888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536c46ea6974491ba2557e3de1c58876', 'request_id': 'req-b6c06068-6c67-4c29-84db-8a10b1cf68d7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.334079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536c46ea6974491ba2557e3de1c58876', 'request_id': 'req-b6c06068-6c67-4c29-84db-8a10b1cf68d7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.350951 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] The token cache is being invalidate because project 536c46ea6974491ba2557e3de1c58876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:27.351249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.351866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.353544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1306/2626] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:27 2022] DELETE /identity/v3/projects/536c46ea6974491ba2557e3de1c58876 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:27.358710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:27.373320 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fabf29-d09f-45a6-a0e6-4c344af31fb9 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:27.443146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:27.444067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:27.444355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:27.444636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] PATH_INFO: `/v3/users/9fd9cfeead82498db5b55a85f5db4836` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:27.445883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd9cfeead82498db5b55a85f5db4836)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:27.447912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:27.496013 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd9cfeead82498db5b55a85f5db4836'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.496658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd9cfeead82498db5b55a85f5db4836'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.497376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd9cfeead82498db5b55a85f5db4836'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.513201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd9cfeead82498db5b55a85f5db4836'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.525796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd9cfeead82498db5b55a85f5db4836'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.539294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1321/2627] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:27 2022] DELETE /identity/v3/users/9fd9cfeead82498db5b55a85f5db4836 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:27.838832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:27.840389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:27.856326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06068-6c67-4c29-84db-8a10b1cf68d7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:27.916202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:27.917088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:27.917376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:27.917654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] PATH_INFO: `/v3/projects/05ce971ce5b54ccfbecde78f70611511` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:27.919284 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ce971ce5b54ccfbecde78f70611511)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:27.921632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:27.973431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ce971ce5b54ccfbecde78f70611511', 'request_id': 'req-88baadcf-11d3-4e48-9f0d-f143ad054faa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.979591 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ce971ce5b54ccfbecde78f70611511', 'request_id': 'req-88baadcf-11d3-4e48-9f0d-f143ad054faa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:27.984052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:27.986820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ce971ce5b54ccfbecde78f70611511', 'request_id': 'req-88baadcf-11d3-4e48-9f0d-f143ad054faa'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.001521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] The token cache is being invalidate because project 05ce971ce5b54ccfbecde78f70611511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:28.001815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.002544 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.004394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1307/2628] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:27 2022] DELETE /identity/v3/projects/05ce971ce5b54ccfbecde78f70611511 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:28.008446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:28.010035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:28.023011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec9d2c-f5da-4c95-8c1b-f0b3cd3797f8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:28.048093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:28.088614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:28.089428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:28.089706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:28.089995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] PATH_INFO: `/v3/users/b33f1525389941f28ae37e1d5374aff5` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:28.091240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33f1525389941f28ae37e1d5374aff5)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:28.093166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:28.155410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33f1525389941f28ae37e1d5374aff5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.156064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33f1525389941f28ae37e1d5374aff5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.156685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33f1525389941f28ae37e1d5374aff5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.165157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33f1525389941f28ae37e1d5374aff5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.178180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33f1525389941f28ae37e1d5374aff5'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.191481 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1322/2629] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:28 2022] DELETE /identity/v3/users/b33f1525389941f28ae37e1d5374aff5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:28.465630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:28.467355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:28.481032 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88baadcf-11d3-4e48-9f0d-f143ad054faa admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:28.538603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:28.539492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:28.539771 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:28.540074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] PATH_INFO: `/v3/projects/b7786c87a4c046e49a87801ee8408ad7` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:28.541228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7786c87a4c046e49a87801ee8408ad7)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:28.543142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:28.592323 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7786c87a4c046e49a87801ee8408ad7', 'request_id': 'req-5c374454-837c-4491-8d44-be0eb8c13346'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.598388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7786c87a4c046e49a87801ee8408ad7', 'request_id': 'req-5c374454-837c-4491-8d44-be0eb8c13346'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.604190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7786c87a4c046e49a87801ee8408ad7', 'request_id': 'req-5c374454-837c-4491-8d44-be0eb8c13346'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.619592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] The token cache is being invalidate because project b7786c87a4c046e49a87801ee8408ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:28.619884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.620484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5c374454-837c-4491-8d44-be0eb8c13346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.622057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1308/2630] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:28 2022] DELETE /identity/v3/projects/b7786c87a4c046e49a87801ee8408ad7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:28.663020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:28.664710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:28.678136 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248a4d1-f574-4243-bafc-53a7d6f1ef35 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:28.743089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:28.744027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:28.744334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:28.744610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] PATH_INFO: `/v3/users/5c28ad94ceb04bb38114f4bc4def0aed` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:28.745838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c28ad94ceb04bb38114f4bc4def0aed)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:28.747917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:28.800724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c28ad94ceb04bb38114f4bc4def0aed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.801388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c28ad94ceb04bb38114f4bc4def0aed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.801989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c28ad94ceb04bb38114f4bc4def0aed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.804325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:28.813426 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c28ad94ceb04bb38114f4bc4def0aed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.828487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c28ad94ceb04bb38114f4bc4def0aed'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:28.841670 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1323/2631] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:28 2022] DELETE /identity/v3/users/5c28ad94ceb04bb38114f4bc4def0aed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:28.846056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:28.846523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:28.846647 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:28.866657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:28.867900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:28.931671 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1309/2632] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:28.941532 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:28.943044 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:29.001315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49053c58-6ae4-43dc-80f0-12f8e8f44e07 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:29.005567 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:29.006251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:29.006542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:29.006813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:29.016519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:29.017966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:29.027549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1324/2633] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:29.305268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:29.307215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:29.320541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257af8-d3c0-40c6-9ff1-0b7c22531156 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:29.325444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:29.326315 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:29.326596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:29.326864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] PATH_INFO: `/v3/projects/1ca9861301de4fe6893b290a11eca4fb` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:29.328110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca9861301de4fe6893b290a11eca4fb)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:29.330028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:29.342341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:29.380409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca9861301de4fe6893b290a11eca4fb', 'request_id': 'req-587009ed-b66b-4450-8da9-ab505a27489e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.386857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca9861301de4fe6893b290a11eca4fb', 'request_id': 'req-587009ed-b66b-4450-8da9-ab505a27489e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.392818 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca9861301de4fe6893b290a11eca4fb', 'request_id': 'req-587009ed-b66b-4450-8da9-ab505a27489e'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.406294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] The token cache is being invalidate because project 1ca9861301de4fe6893b290a11eca4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:29.406561 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.407191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.408761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1310/2634] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:29 2022] DELETE /identity/v3/projects/1ca9861301de4fe6893b290a11eca4fb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:29.413585 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:29.423998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81e99e-47ad-49a8-abe5-2dddf0dfa65c service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:29.490307 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:29.491195 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:29.491534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:29.491813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] PATH_INFO: `/v3/users/7f7a87347c424b57b145339e8c4fef43` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:29.493177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7a87347c424b57b145339e8c4fef43)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:29.495103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:29.542701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7a87347c424b57b145339e8c4fef43'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.543361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7a87347c424b57b145339e8c4fef43'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.544043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7a87347c424b57b145339e8c4fef43'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.552695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7a87347c424b57b145339e8c4fef43'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.564142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:29.565454 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-1477ddb1-56fa-4f56-a11c-1bf4af279d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7a87347c424b57b145339e8c4fef43'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:29.579594 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1325/2635] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:29 2022] DELETE /identity/v3/users/7f7a87347c424b57b145339e8c4fef43 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:29.861931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:29.863461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:29.881308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587009ed-b66b-4450-8da9-ab505a27489e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:29.941624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:29.942419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:29.942700 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:29.943015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] PATH_INFO: `/v3/projects/a69cdd9f5d47459a953b7fc98c0a8483` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:29.944370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69cdd9f5d47459a953b7fc98c0a8483)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:29.946395 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:29.997632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69cdd9f5d47459a953b7fc98c0a8483', 'request_id': 'req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:30.003623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69cdd9f5d47459a953b7fc98c0a8483', 'request_id': 'req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:30.009435 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69cdd9f5d47459a953b7fc98c0a8483', 'request_id': 'req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:30.022264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] The token cache is being invalidate because project a69cdd9f5d47459a953b7fc98c0a8483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:30.022553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:30.023207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-51f41579-7ffc-4f46-b4e1-85459d4dcd8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:30.024762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1311/2636] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:29 2022] DELETE /identity/v3/projects/a69cdd9f5d47459a953b7fc98c0a8483 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:30.030455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.030981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.031419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.051021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:30.052233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:30.115495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1326/2637] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:30.124641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.124930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.125207 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.144708 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:30.145925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:30.154864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1312/2638] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:30.159387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.169505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a668a0b-604b-47e3-9eb2-93d70118a59d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.174124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.174775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.175055 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.175360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.176080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:30.176384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.178016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.189960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1327/2639] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:30.193980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.203738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4f15b-7330-4af2-9f07-5905705425aa None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.209472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.210418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.210806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.211205 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.212228 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.215219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.242506 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1313/2640] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:30.247597 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.263122 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06664edb-780c-43b1-ada1-a08db26b39d1 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.329522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.330199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.330479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.330729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.331467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.333420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.360711 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1328/2641] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:30.366038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.374064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:30.377627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81131a-07a9-4260-942d-0014ffdf1d2a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.384608 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.385385 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.385691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.386017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.386856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.389039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.399949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1314/2642] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:30.404052 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.414941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310f2ba-7abd-4534-8bcb-259e455b84cd admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.420141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa114bc2-ffa7-4caa-ba23-dccd1e53ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.420792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa114bc2-ffa7-4caa-ba23-dccd1e53ad2c admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.421065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa114bc2-ffa7-4caa-ba23-dccd1e53ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.421330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa114bc2-ffa7-4caa-ba23-dccd1e53ad2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.422028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa114bc2-ffa7-4caa-ba23-dccd1e53ad2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.423668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa114bc2-ffa7-4caa-ba23-dccd1e53ad2c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.433959 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1329/2643] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:30.439707 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.450079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf30f-b70e-4088-b175-911133fdd0af admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.455018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.455978 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.456259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.456535 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] PATH_INFO: `/v3/projects/ebffc649f02b4443b81c1f1e88c2fc1e/users/f50cd4e3442c43649bb28ce5f21b18f2/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.472778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebffc649f02b4443b81c1f1e88c2fc1e, user_id=f50cd4e3442c43649bb28ce5f21b18f2, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.475493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.491294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1315/2644] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:30 2022] PUT /identity/v3/projects/ebffc649f02b4443b81c1f1e88c2fc1e/users/f50cd4e3442c43649bb28ce5f21b18f2/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:30.501474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.501762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.502039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.528356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] MFA Rules not processed for user `f50cd4e3442c43649bb28ce5f21b18f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:30.529579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:30.581819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:30.611299 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1330/2645] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:30.616125 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.680480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23dc7-1540-4f8f-8eeb-affb5d5fd03b admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.685756 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.686407 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.686694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.686973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.687813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.689733 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.718715 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1316/2646] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:30.722905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.734102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421fcf7-2f81-4348-bfe2-a4d26e5bb278 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.798642 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.799350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.799628 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.799900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.800672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.802584 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.823830 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1331/2647] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:30 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:30.828456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.843342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc1254-a518-4b10-9b5f-377bac28c5a6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.849402 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.850074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.850360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.850631 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.851401 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.853016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.864326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1317/2648] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:30.868779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.879837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d69bb2-53c0-41de-98cd-7c914741286a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:30.886947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:30.888234 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:30.888611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:30.888931 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] PATH_INFO: `/v3/projects/01b4a603e79e465797dab6667853f72b/users/2e09572bc0244302abf83a8d30314d37/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:30.905824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b4a603e79e465797dab6667853f72b, user_id=2e09572bc0244302abf83a8d30314d37, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:30.908553 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:30.923564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1332/2649] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:30 2022] PUT /identity/v3/projects/01b4a603e79e465797dab6667853f72b/users/2e09572bc0244302abf83a8d30314d37/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:30.929578 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:30.942895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df982ca-f060-4ad5-aafe-d9654cc76df0 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:31.005291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c520517-5dd8-4c74-b18e-ea48192b8318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:31.005888 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520517-5dd8-4c74-b18e-ea48192b8318 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.006172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520517-5dd8-4c74-b18e-ea48192b8318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.006452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c520517-5dd8-4c74-b18e-ea48192b8318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.007191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520517-5dd8-4c74-b18e-ea48192b8318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:31.009255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c520517-5dd8-4c74-b18e-ea48192b8318 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:31.018891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1318/2650] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:31.023203 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:31.033983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8fb24-ca1e-4716-bd6e-a5c085c447c6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:31.039759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:31.040637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.040916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.041188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] PATH_INFO: `/v3/projects/01b4a603e79e465797dab6667853f72b/users/2e09572bc0244302abf83a8d30314d37/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.043242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b4a603e79e465797dab6667853f72b, user_id=2e09572bc0244302abf83a8d30314d37, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:31.045984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:31.056451 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1333/2651] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:31 2022] PUT /identity/v3/projects/01b4a603e79e465797dab6667853f72b/users/2e09572bc0244302abf83a8d30314d37/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:31.067627 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.067920 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.068189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.099210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] MFA Rules not processed for user `2e09572bc0244302abf83a8d30314d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:31.100483 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:31.129654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:31.177709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1319/2652] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:31.189799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:31.191891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:31.260961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0da0df-4d66-4f28-8769-1cfa26ae9142 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:31.265199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:31.265859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.266147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.266478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.275768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:31.277218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:31.289751 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1334/2653] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:31.361371 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:31.362898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:31.376249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6630a66-1fe1-460e-a7c6-985c6c6a17b1 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:31.379898 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab000c7-0eda-45a1-b45f-054411c6dbd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:31.380573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab000c7-0eda-45a1-b45f-054411c6dbd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.380834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab000c7-0eda-45a1-b45f-054411c6dbd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.381109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab000c7-0eda-45a1-b45f-054411c6dbd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.443348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab000c7-0eda-45a1-b45f-054411c6dbd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:31.444837 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab000c7-0eda-45a1-b45f-054411c6dbd3 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:31.454514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1320/2654] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:31.748921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:31.796395 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:31.819884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f250-bb85-4f19-80f6-5037e7e01931 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:31.824335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:31.825236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.825519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.825794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] PATH_INFO: `/v3/users/f50cd4e3442c43649bb28ce5f21b18f2` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.826956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50cd4e3442c43649bb28ce5f21b18f2)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:31.829010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:31.882163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50cd4e3442c43649bb28ce5f21b18f2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:31.883035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50cd4e3442c43649bb28ce5f21b18f2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:31.883934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50cd4e3442c43649bb28ce5f21b18f2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:31.894051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50cd4e3442c43649bb28ce5f21b18f2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:31.906225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50cd4e3442c43649bb28ce5f21b18f2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:31.919116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1335/2655] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:31 2022] DELETE /identity/v3/users/f50cd4e3442c43649bb28ce5f21b18f2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:31.923811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:31.924263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:31.924495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:31.941908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:31.943107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:32.004257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1321/2656] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:32.015142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:32.016689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:32.108170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62503d-b476-4d7f-a0b7-326cf436e99a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:32.112845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:32.113521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:32.113809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:32.114084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:32.126038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:32.127697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:32.137910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1336/2657] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:32.434725 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:32.436259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:32.448731 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdb12f-fe0d-4e89-a5cc-a41d8ce6905f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:32.454589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:32.455525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:32.455808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:32.456110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] PATH_INFO: `/v3/projects/ebffc649f02b4443b81c1f1e88c2fc1e` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:32.457424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebffc649f02b4443b81c1f1e88c2fc1e)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:32.459353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:32.508981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebffc649f02b4443b81c1f1e88c2fc1e', 'request_id': 'req-4f009a38-5713-4796-a649-14182bd5f475'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.515711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebffc649f02b4443b81c1f1e88c2fc1e', 'request_id': 'req-4f009a38-5713-4796-a649-14182bd5f475'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.517774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:32.522510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebffc649f02b4443b81c1f1e88c2fc1e', 'request_id': 'req-4f009a38-5713-4796-a649-14182bd5f475'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.536295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] The token cache is being invalidate because project ebffc649f02b4443b81c1f1e88c2fc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:32.536521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.537455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.539085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1322/2658] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:32 2022] DELETE /identity/v3/projects/ebffc649f02b4443b81c1f1e88c2fc1e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:32.543134 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:32.555768 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19b968-7bcf-4828-9b9c-f69d2cde46ae service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:32.595505 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:32.615867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:32.616747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:32.617026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:32.617298 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] PATH_INFO: `/v3/users/2e09572bc0244302abf83a8d30314d37` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:32.618574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e09572bc0244302abf83a8d30314d37)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:32.620601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:32.678746 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e09572bc0244302abf83a8d30314d37'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.679442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e09572bc0244302abf83a8d30314d37'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.680065 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e09572bc0244302abf83a8d30314d37'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.688601 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e09572bc0244302abf83a8d30314d37'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.701447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5279db69-978e-4fcd-9f0a-a1757e6bf30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e09572bc0244302abf83a8d30314d37'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:32.713555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1337/2659] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:32 2022] DELETE /identity/v3/users/2e09572bc0244302abf83a8d30314d37 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:33.002259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.003775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:33.022652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f009a38-5713-4796-a649-14182bd5f475 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.083867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.084745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.085028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.085305 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] PATH_INFO: `/v3/projects/01b4a603e79e465797dab6667853f72b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.086526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b4a603e79e465797dab6667853f72b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.088481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.135422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b4a603e79e465797dab6667853f72b', 'request_id': 'req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:33.141801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b4a603e79e465797dab6667853f72b', 'request_id': 'req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:33.148108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b4a603e79e465797dab6667853f72b', 'request_id': 'req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:33.161650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] The token cache is being invalidate because project 01b4a603e79e465797dab6667853f72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:33.161938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:33.162905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e16b5d1d-5ae8-4fe4-ad48-729d9ab68d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:33.164778 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1323/2660] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:33 2022] DELETE /identity/v3/projects/01b4a603e79e465797dab6667853f72b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:33.169782 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.170274 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.170344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.190130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:33.191550 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:33.251408 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1338/2661] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:33.260599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.260940 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.261239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.282369 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:33.283652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:33.292559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1324/2662] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:33.296979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.307397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f16efc-237f-40d8-a3b5-e674029968ae None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.312932 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.313603 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.313886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.314167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.314887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:33.315224 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.316862 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.328923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1339/2663] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:33.333377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.343027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fedfa-5d78-4d81-86f7-1a71b98231f4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.347808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.348427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.348712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.348984 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.349684 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.351637 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.377134 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1325/2664] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:33 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:33.381325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.391697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96426875-ea9f-4d21-8707-6a754ab39b61 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.436217 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:33.452996 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.453701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.453976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.454273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.454972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.456980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.479724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1340/2665] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:33 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:33.485870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.496641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45012b83-188b-42ac-8535-fa9dcc4ba9f3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.501570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.502234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.502516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.502791 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.503548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.505164 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.515961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1326/2666] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:33.519899 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.529922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfb37-3d91-46f0-9ba0-b7c3711a42c3 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.535226 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ea779-2251-4ef4-be77-9dca6b96e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.535900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea779-2251-4ef4-be77-9dca6b96e379 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.536235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea779-2251-4ef4-be77-9dca6b96e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.536513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ea779-2251-4ef4-be77-9dca6b96e379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.537534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ea779-2251-4ef4-be77-9dca6b96e379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.539180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ea779-2251-4ef4-be77-9dca6b96e379 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.549537 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1341/2667] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:33.553669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.563628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fe5ea-4fa8-480a-9be5-a7cf02d823cf admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.568412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.569297 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.569579 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.569852 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] PATH_INFO: `/v3/projects/2d0975ee4f7b4402b8440e379fdc044b/users/167264a4782a45e686326a0ce26fee06/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.585166 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d0975ee4f7b4402b8440e379fdc044b, user_id=167264a4782a45e686326a0ce26fee06, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.588138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.607974 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1327/2668] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:33 2022] PUT /identity/v3/projects/2d0975ee4f7b4402b8440e379fdc044b/users/167264a4782a45e686326a0ce26fee06/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:33.619818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.620227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.620623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.653776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] MFA Rules not processed for user `167264a4782a45e686326a0ce26fee06`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:33.654942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:33.720964 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1342/2669] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:33.733499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:33.736311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:33.754382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:33.798523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325e471-8747-40ed-b86d-38c39778b9fd admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:33.802380 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa997eb7-9bbe-426b-abfc-6966ec1591b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:33.802956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997eb7-9bbe-426b-abfc-6966ec1591b9 service glance] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:33.803277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997eb7-9bbe-426b-abfc-6966ec1591b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:33.803545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997eb7-9bbe-426b-abfc-6966ec1591b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:33.812086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa997eb7-9bbe-426b-abfc-6966ec1591b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:33.813525 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa997eb7-9bbe-426b-abfc-6966ec1591b9 service glance] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:33.822639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1328/2670] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:34.224507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:34.226008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:34.295213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8df334-58df-4ec1-ae4b-f1cc0ff3a071 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:34.300477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:34.301371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:34.301633 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:34.301918 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] PATH_INFO: `/v3/users/72b799f6a05849609e43f35f57f09800` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:34.303200 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b799f6a05849609e43f35f57f09800)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:34.305334 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:34.355358 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b799f6a05849609e43f35f57f09800'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.356025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b799f6a05849609e43f35f57f09800'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.356844 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b799f6a05849609e43f35f57f09800'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.365273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b799f6a05849609e43f35f57f09800'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.367388 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:34.381915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b799f6a05849609e43f35f57f09800'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.395038 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1343/2671] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:34 2022] DELETE /identity/v3/users/72b799f6a05849609e43f35f57f09800 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:34.400174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:34.400681 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:34.400755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:34.419943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:34.421158 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:34.488448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1329/2672] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:34.498422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:34.500179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:34.560023 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de25b6-1b42-43cb-8202-29c01ed4ce45 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:34.563568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:34.564220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:34.564569 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:34.564849 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:34.574213 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:34.575789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:34.585765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1344/2673] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:53:34.883077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:34.884883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:34.902069 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7a22a-cdc7-48b0-a3d5-4ed2a62cfd3b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:34.908074 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:34.908985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:34.909264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:34.909534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] PATH_INFO: `/v3/projects/7c4618acb15d4a2f8becc157c6bb21e2` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:34.910775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c4618acb15d4a2f8becc157c6bb21e2)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:34.916593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:34.967052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c4618acb15d4a2f8becc157c6bb21e2', 'request_id': 'req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.973752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c4618acb15d4a2f8becc157c6bb21e2', 'request_id': 'req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.980712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c4618acb15d4a2f8becc157c6bb21e2', 'request_id': 'req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.994897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] The token cache is being invalidate because project 7c4618acb15d4a2f8becc157c6bb21e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:34.995196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.995834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:34.997432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1330/2674] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:34 2022] DELETE /identity/v3/projects/7c4618acb15d4a2f8becc157c6bb21e2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:35.001379 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:35.011421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1879-7239-4b60-aa1b-590aef6c7b18 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:35.070757 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:35.071135 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.071391 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.071668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] PATH_INFO: `/v3/users/522cb1c90df741d988d69784a4d6022b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.072869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=522cb1c90df741d988d69784a4d6022b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:35.074840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:35.134057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522cb1c90df741d988d69784a4d6022b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.134804 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522cb1c90df741d988d69784a4d6022b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.135549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522cb1c90df741d988d69784a4d6022b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.144580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522cb1c90df741d988d69784a4d6022b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.156956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-53921c35-467a-4693-9439-7cb7d5172404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522cb1c90df741d988d69784a4d6022b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.162539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:35.172873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1345/2675] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:35 2022] DELETE /identity/v3/users/522cb1c90df741d988d69784a4d6022b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:35.457589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:35.459107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:35.473850 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e188c83-cfa7-432d-b0a6-b6ab7cfb81fc admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:35.514239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:35.540208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:35.541116 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.541398 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.541728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] PATH_INFO: `/v3/projects/5a20595b4ffa42548b56558a3eb9f43e` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.543128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a20595b4ffa42548b56558a3eb9f43e)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:35.546415 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:35.595262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a20595b4ffa42548b56558a3eb9f43e', 'request_id': 'req-a222d12a-ba84-4440-baa1-e108265129cb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.601264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a20595b4ffa42548b56558a3eb9f43e', 'request_id': 'req-a222d12a-ba84-4440-baa1-e108265129cb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.607347 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a20595b4ffa42548b56558a3eb9f43e', 'request_id': 'req-a222d12a-ba84-4440-baa1-e108265129cb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.622954 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] The token cache is being invalidate because project 5a20595b4ffa42548b56558a3eb9f43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:35.623382 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.624529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a222d12a-ba84-4440-baa1-e108265129cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:35.626648 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1331/2676] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:35 2022] DELETE /identity/v3/projects/5a20595b4ffa42548b56558a3eb9f43e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:35.632434 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.632900 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.633042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.653690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:35.655085 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:35.724000 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1346/2677] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:35.732173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.732492 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.732785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.753106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:35.754329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:35.764639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1332/2678] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:53:35.769080 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:35.779639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a532c1-ce76-4350-9ee3-e8687304d4ed None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:35.784701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:35.785373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.785659 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.785936 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.786673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:35.787006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:35.789009 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:35.801717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1347/2679] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:35.806285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:35.816320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4f563-4a9f-4e83-8060-dec78d4a5c24 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:35.821686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:35.822352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.822638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.822915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.823657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:35.825697 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:35.853421 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1333/2680] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:35 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:35.858801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:35.869305 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad0166-5862-46b4-aef8-542abe69b446 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:35.929524 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:35.930202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.930479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.930752 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.931469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:35.933397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:35.959614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1348/2681] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:35 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:35.965062 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:35.982304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa64526-6626-4400-b36f-a547083c1e2d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:35.987665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:35.988379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:35.988672 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:35.988971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:35.989721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:35.991379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.005499 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1334/2682] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:36.010338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.024184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dc3a07-61a1-4acc-8316-ae6e9b3a0f70 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.030797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511ffcb-df18-4649-a3a5-363771a0baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.031859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ffcb-df18-4649-a3a5-363771a0baa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.032173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ffcb-df18-4649-a3a5-363771a0baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.032447 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511ffcb-df18-4649-a3a5-363771a0baa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.033521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511ffcb-df18-4649-a3a5-363771a0baa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.035468 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511ffcb-df18-4649-a3a5-363771a0baa5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.048610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1349/2683] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:36.055191 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.066732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f56be-7605-4de8-8931-50c87b7ff692 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.072796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.074063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.074344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.074642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] PATH_INFO: `/v3/projects/a86fba5460764330b39b8f0c19df1fbe/users/617ec069136140abbf803fb1f1dcb8f6/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.092349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86fba5460764330b39b8f0c19df1fbe, user_id=617ec069136140abbf803fb1f1dcb8f6, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.095968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.116723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1335/2684] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:36 2022] PUT /identity/v3/projects/a86fba5460764330b39b8f0c19df1fbe/users/617ec069136140abbf803fb1f1dcb8f6/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:36.128985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.129276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.129554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.159311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] MFA Rules not processed for user `617ec069136140abbf803fb1f1dcb8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:36.160513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:36.212939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:36.231684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1350/2685] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:36.236266 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.314391 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c3239-914d-4eea-8dd4-31f39081f44f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.319489 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.320150 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.320428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.320698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.321386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.323318 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.331664 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:36.356185 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1336/2686] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:36 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:36.357452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.369125 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d649c-0650-48a7-a9a1-ab6fca7ef5da None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.436903 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.437586 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.437867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.438143 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.438840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.440855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.463937 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1351/2687] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:36 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:53:36.468186 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.479257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240c1d-fa89-4dec-8165-dc0d7ec9548a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.485013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.485683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.485962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.486229 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.486957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.488612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.499329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1337/2688] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:36.504917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.518017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a4f49-b5ef-4a93-bb2f-b45dcd3fd9c6 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.523417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.524444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.524988 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.525264 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] PATH_INFO: `/v3/projects/6ce890dae3994a53b429110103393e01/users/ceea8e44d9fb4bf5b475069dc40fbc12/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.541273 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce890dae3994a53b429110103393e01, user_id=ceea8e44d9fb4bf5b475069dc40fbc12, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.544051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.563070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1352/2689] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:36 2022] PUT /identity/v3/projects/6ce890dae3994a53b429110103393e01/users/ceea8e44d9fb4bf5b475069dc40fbc12/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:36.567066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.578010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf29a62-7db2-4e49-823b-7dbf26a14faa admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.642722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ce963-2244-4497-a5a6-384f6fd75ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.643359 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce963-2244-4497-a5a6-384f6fd75ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.643641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce963-2244-4497-a5a6-384f6fd75ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.643917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ce963-2244-4497-a5a6-384f6fd75ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.644642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ce963-2244-4497-a5a6-384f6fd75ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.646281 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ce963-2244-4497-a5a6-384f6fd75ba0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.656128 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1338/2690] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:53:36.660825 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.673002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1521-9762-4c62-a068-b1912dc1970f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.678487 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.679429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.679681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.680795 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] PATH_INFO: `/v3/projects/6ce890dae3994a53b429110103393e01/users/ceea8e44d9fb4bf5b475069dc40fbc12/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.682061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce890dae3994a53b429110103393e01, user_id=ceea8e44d9fb4bf5b475069dc40fbc12, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.684726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.694916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1353/2691] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:36 2022] PUT /identity/v3/projects/6ce890dae3994a53b429110103393e01/users/ceea8e44d9fb4bf5b475069dc40fbc12/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:36.707372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.707805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.708213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.740151 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] MFA Rules not processed for user `ceea8e44d9fb4bf5b475069dc40fbc12`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:36.741411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:36.822239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1339/2692] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:36.834035 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:36.835976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:36.895769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1418a-1792-462b-8699-e04ff830aec8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:36.900424 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:36.901088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:36.901373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:36.901653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:36.911837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:36.913602 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:36.923042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1354/2693] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:37.035983 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:37.037914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:37.051084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6bcff-e5e6-4d8e-b826-6d5e0e26a3d4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:37.055094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:37.055800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:37.056078 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:37.056348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:37.058875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:37.127361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:37.142961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:37.145009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db0ba9-a96f-4664-ac8b-6d41944790f0 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:37.154584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1340/2694] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:37.351777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:37.400851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:37.418933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01de46-3635-4f18-a7a1-2d3377bcb133 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:37.424204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:37.425091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:37.425373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:37.425652 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] PATH_INFO: `/v3/users/617ec069136140abbf803fb1f1dcb8f6` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:37.426871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] RBAC: Authorizing `identity:delete_user(user_id=617ec069136140abbf803fb1f1dcb8f6)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:37.428963 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:37.477829 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617ec069136140abbf803fb1f1dcb8f6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:37.478492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617ec069136140abbf803fb1f1dcb8f6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:37.479087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617ec069136140abbf803fb1f1dcb8f6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:37.487726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617ec069136140abbf803fb1f1dcb8f6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:37.500979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617ec069136140abbf803fb1f1dcb8f6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:37.513822 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1355/2695] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:37 2022] DELETE /identity/v3/users/617ec069136140abbf803fb1f1dcb8f6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:37.518803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:37.519340 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:37.519443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:37.538766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:37.540145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:37.609404 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1341/2696] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:37.618997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:37.620623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:37.682370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70099428-df03-4c7d-89cd-717ba65b211b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:37.686851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:37.687554 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:37.687835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:37.688116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:37.698730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:37.700220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:37.710239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1356/2697] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:37.995901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:37.997519 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:38.010522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27358621-4ed0-456a-9878-4c3116ab3012 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:38.020383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:38.021288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.021573 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.021849 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] PATH_INFO: `/v3/projects/a86fba5460764330b39b8f0c19df1fbe` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.023173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86fba5460764330b39b8f0c19df1fbe)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:38.025145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:38.077657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86fba5460764330b39b8f0c19df1fbe', 'request_id': 'req-13596fcb-6519-42a7-a244-ce8ae1031bad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.084422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86fba5460764330b39b8f0c19df1fbe', 'request_id': 'req-13596fcb-6519-42a7-a244-ce8ae1031bad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.091192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86fba5460764330b39b8f0c19df1fbe', 'request_id': 'req-13596fcb-6519-42a7-a244-ce8ae1031bad'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.106056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] The token cache is being invalidate because project a86fba5460764330b39b8f0c19df1fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:38.106439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.107163 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.108855 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1342/2698] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:37 2022] DELETE /identity/v3/projects/a86fba5460764330b39b8f0c19df1fbe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:38.113028 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:38.123801 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef15e13e-af53-49b1-a89b-7c0d12d91ec5 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:38.186734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:38.187647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.187928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.188197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] PATH_INFO: `/v3/users/ceea8e44d9fb4bf5b475069dc40fbc12` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.189367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceea8e44d9fb4bf5b475069dc40fbc12)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:38.191328 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:38.202673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:38.243026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceea8e44d9fb4bf5b475069dc40fbc12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.243668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceea8e44d9fb4bf5b475069dc40fbc12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.244233 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceea8e44d9fb4bf5b475069dc40fbc12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.251747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceea8e44d9fb4bf5b475069dc40fbc12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.268577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-5a42c8bd-73d7-4cd3-af1b-05a815ef8b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceea8e44d9fb4bf5b475069dc40fbc12'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.281315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1357/2699] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:38 2022] DELETE /identity/v3/users/ceea8e44d9fb4bf5b475069dc40fbc12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:38.581234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:38.582659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:38.596180 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596fcb-6519-42a7-a244-ce8ae1031bad admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:38.659308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:38.660169 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.660469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.660732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] PATH_INFO: `/v3/projects/6ce890dae3994a53b429110103393e01` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.661938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce890dae3994a53b429110103393e01)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:38.664263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:38.676641 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:38.716018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce890dae3994a53b429110103393e01', 'request_id': 'req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.722403 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce890dae3994a53b429110103393e01', 'request_id': 'req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.727873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce890dae3994a53b429110103393e01', 'request_id': 'req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.740694 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] The token cache is being invalidate because project 6ce890dae3994a53b429110103393e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:38.741009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.741624 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6bafc5c7-0c04-48ca-b9bf-dbb1d96266bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:38.746682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1343/2700] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:38 2022] DELETE /identity/v3/projects/6ce890dae3994a53b429110103393e01 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:53:38.748681 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.749158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.749158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.768090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:38.769272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:38.835788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1358/2701] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:53:38.844590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.844957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.845301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.868868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:38.870085 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:38.879344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1344/2702] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:38.883747 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:38.893941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36275ece-83e4-429a-9253-5ca4decab499 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:38.899321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:38.899993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.900272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.900543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.901266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:38.901570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:38.903206 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:38.915228 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1359/2703] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:38.920050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:38.929828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47176880-11ba-46a6-8939-ee92a6842224 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:38.935129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:38.935807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:38.936088 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:38.936361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:38.937010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:38.938938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:38.966703 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1345/2704] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:38 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:38.972148 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:38.982460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f2ecc-d0a0-4a23-a141-c0b2b04cf9ba admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.039724 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.040404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.040684 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.040958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.041656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.043613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.068325 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1360/2705] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:38 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:39.070714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.083045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144273-d07d-4c67-be04-ac86539cdac3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.093014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.093865 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.094152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.094448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.095212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.096861 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.108521 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1346/2706] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:39.112890 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.122623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:39.127350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a518c62-b25b-45a7-ae43-ed9d66b3f190 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.135534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98468d3e-ed83-416c-b775-7f287b0c40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.136304 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468d3e-ed83-416c-b775-7f287b0c40a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.136660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468d3e-ed83-416c-b775-7f287b0c40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.137048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98468d3e-ed83-416c-b775-7f287b0c40a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.138208 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468d3e-ed83-416c-b775-7f287b0c40a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.140428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98468d3e-ed83-416c-b775-7f287b0c40a3 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.152837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1361/2707] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:39.157316 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.168383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a0fe0-0d6f-47ce-ba00-c5560d33c814 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.173777 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.174658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.174937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.175248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] PATH_INFO: `/v3/projects/df34c4f737504974bbb7633c202f94a0/users/294cfad11df84615ac764684fb61df47/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.191210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df34c4f737504974bbb7633c202f94a0, user_id=294cfad11df84615ac764684fb61df47, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.193886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.208709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1347/2708] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:39 2022] PUT /identity/v3/projects/df34c4f737504974bbb7633c202f94a0/users/294cfad11df84615ac764684fb61df47/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:39.219577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.219894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.220197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.247577 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] MFA Rules not processed for user `294cfad11df84615ac764684fb61df47`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:39.248943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:39.318285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1362/2709] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:39.322942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.388422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b39ff-abe3-4ce7-b8af-86aa875e5c53 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.393173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.393859 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.394143 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.394437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.395196 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.397192 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.426330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1348/2710] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:39 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:39.430583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.449521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529620fe-a11d-4647-8bdb-5a7814c73da8 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.511368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.512063 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.512344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.512730 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.513363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.515322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.538712 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1363/2711] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:39 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:39.544712 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.556111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a00e5-d57e-4825-9984-0b9570009afa admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.561623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.562405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.562723 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.563005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.563858 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.565490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.577495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1349/2712] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:39.581805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.592107 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25745b-0d11-40f2-a44d-cf0fb0e2cb11 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.597894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.599021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.599478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.599851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] PATH_INFO: `/v3/projects/26fe2455541e4abf92725c4159760a47/users/eaeaaf0278cc483dac9ce483cfbc4db4/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.617546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fe2455541e4abf92725c4159760a47, user_id=eaeaaf0278cc483dac9ce483cfbc4db4, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.620270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.642971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1364/2713] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:39 2022] PUT /identity/v3/projects/26fe2455541e4abf92725c4159760a47/users/eaeaaf0278cc483dac9ce483cfbc4db4/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:39.647877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.664693 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e89c683-d328-4f84-80e4-7746510e0bb9 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.674815 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:39.729948 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eb2a5-5b9c-4b1d-ae38-653e088e0bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.730633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eb2a5-5b9c-4b1d-ae38-653e088e0bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.730917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eb2a5-5b9c-4b1d-ae38-653e088e0bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.731277 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eb2a5-5b9c-4b1d-ae38-653e088e0bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.732017 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eb2a5-5b9c-4b1d-ae38-653e088e0bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.733621 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eb2a5-5b9c-4b1d-ae38-653e088e0bbc admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.743822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1350/2714] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:39.748283 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.759727 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e63c77-1add-416b-bb3d-846c03588e92 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.764725 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.765677 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.765957 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.766231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] PATH_INFO: `/v3/projects/26fe2455541e4abf92725c4159760a47/users/eaeaaf0278cc483dac9ce483cfbc4db4/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.768297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fe2455541e4abf92725c4159760a47, user_id=eaeaaf0278cc483dac9ce483cfbc4db4, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.770966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:39.782630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1365/2715] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:39 2022] PUT /identity/v3/projects/26fe2455541e4abf92725c4159760a47/users/eaeaaf0278cc483dac9ce483cfbc4db4/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:39.798699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.798873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.799252 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.831447 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] MFA Rules not processed for user `eaeaaf0278cc483dac9ce483cfbc4db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:39.832657 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:39.908000 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1351/2716] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:39.920351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:39.922230 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:39.962922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:39.982042 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c401a1-a81c-49d8-8d64-ecfef6ace046 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:39.985796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae088a4-a79f-4334-99eb-6ccd17d7224c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:39.986446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae088a4-a79f-4334-99eb-6ccd17d7224c service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:39.986726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae088a4-a79f-4334-99eb-6ccd17d7224c service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:39.987006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae088a4-a79f-4334-99eb-6ccd17d7224c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:39.996983 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae088a4-a79f-4334-99eb-6ccd17d7224c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:39.998521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae088a4-a79f-4334-99eb-6ccd17d7224c service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:40.008266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1366/2717] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:40.036999 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:40.104594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba668605-6326-45f2-a8ba-f9563f68fe7f None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:40.109776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:40.110678 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:40.110956 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:40.111263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] PATH_INFO: `/v3/users/294cfad11df84615ac764684fb61df47` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:40.112504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] RBAC: Authorizing `identity:delete_user(user_id=294cfad11df84615ac764684fb61df47)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:40.114473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:40.161131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:40.174537 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294cfad11df84615ac764684fb61df47'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.184950 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294cfad11df84615ac764684fb61df47'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.185713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294cfad11df84615ac764684fb61df47'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.186370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294cfad11df84615ac764684fb61df47'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.199179 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294cfad11df84615ac764684fb61df47'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.211825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1352/2718] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:40 2022] DELETE /identity/v3/users/294cfad11df84615ac764684fb61df47 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:40.216497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:40.216790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:40.217074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:40.238750 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:40.240001 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:40.308245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1367/2719] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:40.318068 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:40.319616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:40.394493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf0a3e-974f-4f77-b495-3c1427e5668e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:40.398564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:40.399259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:40.399538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:40.399816 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:40.409247 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:40.410726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:40.425437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1353/2720] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:40.704729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:40.706284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:40.722281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831389a-d705-4d2b-955f-12b726b8b40c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:40.727837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:40.728738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:40.728969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:40.729440 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] PATH_INFO: `/v3/projects/df34c4f737504974bbb7633c202f94a0` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:40.730544 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df34c4f737504974bbb7633c202f94a0)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:40.732486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:40.783867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df34c4f737504974bbb7633c202f94a0', 'request_id': 'req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.791112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df34c4f737504974bbb7633c202f94a0', 'request_id': 'req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.796699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df34c4f737504974bbb7633c202f94a0', 'request_id': 'req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.809841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] The token cache is being invalidate because project df34c4f737504974bbb7633c202f94a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:40.810133 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.810741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.812321 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1368/2721] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:40 2022] DELETE /identity/v3/projects/df34c4f737504974bbb7633c202f94a0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:40.816605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:40.827300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f2648-428c-4802-ae34-d1be1cd6b92d service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:40.895825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:40.896744 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:40.897024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:40.897296 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] PATH_INFO: `/v3/users/eaeaaf0278cc483dac9ce483cfbc4db4` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:40.898515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaeaaf0278cc483dac9ce483cfbc4db4)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:40.900555 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:40.951979 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaeaaf0278cc483dac9ce483cfbc4db4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.960436 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaeaaf0278cc483dac9ce483cfbc4db4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.961061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaeaaf0278cc483dac9ce483cfbc4db4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.961663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaeaaf0278cc483dac9ce483cfbc4db4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.964072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:40.975728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-c8ee87d5-e894-43d5-9764-9e659832430d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaeaaf0278cc483dac9ce483cfbc4db4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:40.988071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1354/2722] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:40 2022] DELETE /identity/v3/users/eaeaaf0278cc483dac9ce483cfbc4db4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:41.286072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.288095 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:41.305242 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3613d-00a4-43cd-81d7-59f9b4e7bf45 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.370199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.370999 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.371311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.371580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] PATH_INFO: `/v3/projects/26fe2455541e4abf92725c4159760a47` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.372813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fe2455541e4abf92725c4159760a47)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.374777 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.377190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:41.434197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fe2455541e4abf92725c4159760a47', 'request_id': 'req-56707be7-7dbc-4c81-8816-7f9c0221247d'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:41.440743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fe2455541e4abf92725c4159760a47', 'request_id': 'req-56707be7-7dbc-4c81-8816-7f9c0221247d'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:41.446467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fe2455541e4abf92725c4159760a47', 'request_id': 'req-56707be7-7dbc-4c81-8816-7f9c0221247d'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:41.459703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] The token cache is being invalidate because project 26fe2455541e4abf92725c4159760a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:41.459992 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:41.460600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-56707be7-7dbc-4c81-8816-7f9c0221247d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:41.462140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1369/2723] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:41 2022] DELETE /identity/v3/projects/26fe2455541e4abf92725c4159760a47 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:41.467138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.467425 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.467699 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.485094 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:41.486260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:41.546484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1355/2724] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:53:41.555100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.555455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.555740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.575469 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:41.576760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:41.585917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1370/2725] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:41.590877 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.606429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9f5ea-ba4f-4a8f-b713-ca7009c581e1 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.611680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.612338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.612622 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.612897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.613620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:41.613929 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.615586 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.629503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1356/2726] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:41.634142 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.643695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148b10c-185b-448f-a727-9897ee6f771c None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.648437 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.649060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.649339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.649617 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.650297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.652270 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.681953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1371/2727] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:41 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:41.688388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.702796 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288eaee-b223-4e70-9f45-c3dada3e52d6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.763686 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.764367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.764652 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.764930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.766009 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.768014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.796178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1357/2728] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:41 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:41.799288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.811124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7be3-9986-41e1-8984-35b1b385f4e4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.816954 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.817635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.817917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.818198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.818924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.820656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.832905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1372/2729] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:41.838082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.855866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009ddeb-06d6-4252-af81-0b8d81fb5192 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.862721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b068af9-c4d5-4cc9-a4b4-927591dead8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.863716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b068af9-c4d5-4cc9-a4b4-927591dead8e admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.864110 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b068af9-c4d5-4cc9-a4b4-927591dead8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.864498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b068af9-c4d5-4cc9-a4b4-927591dead8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.865611 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b068af9-c4d5-4cc9-a4b4-927591dead8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.867351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b068af9-c4d5-4cc9-a4b4-927591dead8e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.884063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1358/2730] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:41.888646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:41.901492 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c629f3-96db-4aa4-976e-dc00b8247757 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:41.909938 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:41.911219 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.911615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.911935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] PATH_INFO: `/v3/projects/0ff6289cbb0b46d88c74a17dfa46ecd3/users/af035faf4fbe4a7e96b1f9ebadc0beb8/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.930622 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff6289cbb0b46d88c74a17dfa46ecd3, user_id=af035faf4fbe4a7e96b1f9ebadc0beb8, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:41.933389 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:41.952147 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1373/2731] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:41 2022] PUT /identity/v3/projects/0ff6289cbb0b46d88c74a17dfa46ecd3/users/af035faf4fbe4a7e96b1f9ebadc0beb8/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:41.963822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:41.964107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:41.964412 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:41.993922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] MFA Rules not processed for user `af035faf4fbe4a7e96b1f9ebadc0beb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:41.995138 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:42.029311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:42.071237 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1359/2732] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:42.084173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:42.085246 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:42.148974 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711aae12-1631-4fe9-adc4-14970a0fffba admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:42.152814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85703-de2d-4a36-beb7-4d0cccb141c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '096d124cc0484429858b2e5f6790ecb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:42.153510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85703-de2d-4a36-beb7-4d0cccb141c2 service glance] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:42.153791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85703-de2d-4a36-beb7-4d0cccb141c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:42.154087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85703-de2d-4a36-beb7-4d0cccb141c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:42.162915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d85703-de2d-4a36-beb7-4d0cccb141c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:42.164485 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d85703-de2d-4a36-beb7-4d0cccb141c2 service glance] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:42.174310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1374/2733] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:51.664067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:51.665658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:51.736655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3720d-357c-463f-bf66-6dc364a3d26b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:51.741376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:51.742257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:51.742534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:51.742801 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] PATH_INFO: `/v3/users/167264a4782a45e686326a0ce26fee06` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:51.744013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=167264a4782a45e686326a0ce26fee06)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:51.745928 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:51.799098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167264a4782a45e686326a0ce26fee06'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:51.810005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167264a4782a45e686326a0ce26fee06'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:51.810711 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167264a4782a45e686326a0ce26fee06'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:51.811377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167264a4782a45e686326a0ce26fee06'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:51.824242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167264a4782a45e686326a0ce26fee06'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:51.838379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1360/2734] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:53:51 2022] DELETE /identity/v3/users/167264a4782a45e686326a0ce26fee06 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:51.843375 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:51.843859 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:51.843942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:51.861557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:51.862879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:51.892026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:51.939741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1375/2735] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:51.951014 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:51.952475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:52.008298 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:52.012502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444a684-2716-436b-8b27-2843da5d73ad admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.017527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc867c-2697-48f1-82f4-0de863d63842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.018194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc867c-2697-48f1-82f4-0de863d63842 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.018552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc867c-2697-48f1-82f4-0de863d63842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.019045 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc867c-2697-48f1-82f4-0de863d63842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.028794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc867c-2697-48f1-82f4-0de863d63842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.030240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc867c-2697-48f1-82f4-0de863d63842 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.040763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1361/2736] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:52.324383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.326533 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:52.341039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e388f-b234-4cc9-8baf-f099761896b7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.346043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.346922 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.347247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.347526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] PATH_INFO: `/v3/projects/2d0975ee4f7b4402b8440e379fdc044b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.348749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d0975ee4f7b4402b8440e379fdc044b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.350691 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.405370 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d0975ee4f7b4402b8440e379fdc044b', 'request_id': 'req-4da306db-76a3-469d-8ec8-f87416add7bf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:52.411520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d0975ee4f7b4402b8440e379fdc044b', 'request_id': 'req-4da306db-76a3-469d-8ec8-f87416add7bf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:52.418676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d0975ee4f7b4402b8440e379fdc044b', 'request_id': 'req-4da306db-76a3-469d-8ec8-f87416add7bf'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:52.432220 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] The token cache is being invalidate because project 2d0975ee4f7b4402b8440e379fdc044b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:53:52.432482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:52.433115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-4da306db-76a3-469d-8ec8-f87416add7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:53:52.434913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1376/2737] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:53:52 2022] DELETE /identity/v3/projects/2d0975ee4f7b4402b8440e379fdc044b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:52.440302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.440682 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.441028 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.459574 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:52.460908 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:52.523337 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1362/2738] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:52.531644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.531963 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.532245 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.552653 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:52.553873 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:52.562036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1377/2739] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:52.566467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.576411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe27a15-d0b3-4003-aff5-d569a39270e4 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.581559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.582260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.582539 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.582810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.583584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:53:52.583986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.585856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.601845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1363/2740] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:53:52.606512 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.616654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f30f-9351-4f50-bbfb-d397a13c35f8 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.622668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.623361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.623643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.623919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.624611 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.626545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.658026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1378/2741] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:52 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:52.662455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.672902 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4115-1611-4146-97c9-50aed02535e8 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.735735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.736524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.736875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.737197 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.737903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.740287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.759662 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1364/2742] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:52 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:52.764363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.777697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb9560-c85f-4368-a9e6-7fc435fec706 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.783845 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.784521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.784827 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.785101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.785833 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.787809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.799359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1379/2743] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:52.804021 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.815632 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964ffc-e85f-4e51-8569-06d126354c4c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.821757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fb5f8-ba10-4f32-a381-cbfa6a818b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.822432 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb5f8-ba10-4f32-a381-cbfa6a818b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.822716 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb5f8-ba10-4f32-a381-cbfa6a818b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.822988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fb5f8-ba10-4f32-a381-cbfa6a818b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.823748 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fb5f8-ba10-4f32-a381-cbfa6a818b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.825443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fb5f8-ba10-4f32-a381-cbfa6a818b1b admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.836056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1365/2744] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:52.840446 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:52.852879 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffaaeae-54c7-47a3-8fda-68c035a3a9d9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:52.858420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:52.859362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.859647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.859920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] PATH_INFO: `/v3/projects/f34b73b9b08c4ae48d4ba6d9ab94ba9b/users/bd4f42cd6697491ea5f1f3693daf0c95/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.876473 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34b73b9b08c4ae48d4ba6d9ab94ba9b, user_id=bd4f42cd6697491ea5f1f3693daf0c95, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:52.879187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:52.893740 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1380/2745] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:52 2022] PUT /identity/v3/projects/f34b73b9b08c4ae48d4ba6d9ab94ba9b/users/bd4f42cd6697491ea5f1f3693daf0c95/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:52.956037 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:52.956244 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:52.956517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:52.985639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] MFA Rules not processed for user `bd4f42cd6697491ea5f1f3693daf0c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:52.986901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:53.032312 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:53.052775 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1366/2746] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:53.057396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.112360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:53.124535 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5df7e-f091-44f7-afdf-c36e5bd97299 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.130341 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.131011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.131318 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.131589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.132297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.134247 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.167600 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1381/2747] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:53 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:53.172072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.186570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae409a0b-0b4d-43bd-b1e2-f586285f9938 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.246884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.247617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.247894 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.248124 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.248882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.250990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.272162 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1367/2748] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:53 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:53.276397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.287786 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3396a-dbe8-4b21-819c-2e243b976427 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.292540 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.293210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.293496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.293773 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.294503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.296172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.307352 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1382/2749] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:53.311597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.321927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03facdb-f8b2-454a-a8e0-ff4b958d248a admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.326789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74d4f-1c23-4497-9104-fab4f9ceb8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.327484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74d4f-1c23-4497-9104-fab4f9ceb8ea admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.327769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74d4f-1c23-4497-9104-fab4f9ceb8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.328046 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74d4f-1c23-4497-9104-fab4f9ceb8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.328765 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e74d4f-1c23-4497-9104-fab4f9ceb8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.330360 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e74d4f-1c23-4497-9104-fab4f9ceb8ea admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.340868 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1368/2750] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:53.345421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.356025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bbc9e-7ef4-4bcb-ae7c-e1927a537141 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.360760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.361644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.361928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.362216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] PATH_INFO: `/v3/projects/7b04f4a05b0b4355ba99d2c4879fa9e3/users/f12e3eaa04224c48a8c2fa638a71f730/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.378116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b04f4a05b0b4355ba99d2c4879fa9e3, user_id=f12e3eaa04224c48a8c2fa638a71f730, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.380858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.396207 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1383/2751] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:53 2022] PUT /identity/v3/projects/7b04f4a05b0b4355ba99d2c4879fa9e3/users/f12e3eaa04224c48a8c2fa638a71f730/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:53.406526 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.406813 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.407089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.434498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] MFA Rules not processed for user `f12e3eaa04224c48a8c2fa638a71f730`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:53.435769 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:53.501255 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1369/2752] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:53.505928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.570039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3281f-4521-48ef-9303-e0ec2e8ee759 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.574759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.575496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.575796 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.576062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.576744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.578646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.604357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1384/2753] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:53:53 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:53.608616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.619564 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62532363-0fe2-4a08-9bb6-1b2c1d5d9a90 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.669646 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:53.677827 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.678518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.678804 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.679086 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.680122 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.682057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.703880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1370/2754] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:53:53 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:53:53.707984 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.719579 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5141d0-2c20-4ef2-9c54-c19ff3ee4d8b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.725256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.725917 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.726199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.726478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.727205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.728860 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.739946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1385/2755] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:53.744363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.754795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021fa9c-5a5a-4c86-92bc-d0ad2ffb64c3 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.759768 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.760655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.760935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.761215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] PATH_INFO: `/v3/projects/7bab305a4f9b45e386338e53048e4a3f/users/89f3598e12954a64923e4e2c1072f775/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.775845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bab305a4f9b45e386338e53048e4a3f, user_id=89f3598e12954a64923e4e2c1072f775, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.778696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.795336 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1371/2756] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:53 2022] PUT /identity/v3/projects/7bab305a4f9b45e386338e53048e4a3f/users/89f3598e12954a64923e4e2c1072f775/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:53.799368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.809559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258f78d-fdd6-4440-ba8c-ffd36150312a admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.868765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2c4fb-8c87-4e25-8f71-8c05fbce4236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.869472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c4fb-8c87-4e25-8f71-8c05fbce4236 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.869758 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c4fb-8c87-4e25-8f71-8c05fbce4236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.870037 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2c4fb-8c87-4e25-8f71-8c05fbce4236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.870759 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2c4fb-8c87-4e25-8f71-8c05fbce4236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.872420 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2c4fb-8c87-4e25-8f71-8c05fbce4236 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.882178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1386/2757] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:53:53.886434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:53.897002 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6bed7-de63-4843-bf68-78257d400423 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:53.901966 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:53.902896 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.903178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.903493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] PATH_INFO: `/v3/projects/7bab305a4f9b45e386338e53048e4a3f/users/89f3598e12954a64923e4e2c1072f775/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.905474 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bab305a4f9b45e386338e53048e4a3f, user_id=89f3598e12954a64923e4e2c1072f775, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:53.908215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:53.918565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1372/2758] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:53:53 2022] PUT /identity/v3/projects/7bab305a4f9b45e386338e53048e4a3f/users/89f3598e12954a64923e4e2c1072f775/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:53:53.929927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745ac19-871f-4295-a992-f990ff13649b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:53.930218 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745ac19-871f-4295-a992-f990ff13649b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:53.930486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745ac19-871f-4295-a992-f990ff13649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:53.951398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:53:53.962593 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1745ac19-871f-4295-a992-f990ff13649b None None] MFA Rules not processed for user `89f3598e12954a64923e4e2c1072f775`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:53:53.964402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1745ac19-871f-4295-a992-f990ff13649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:54.039574 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1387/2759] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:53:54.051595 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:54.053394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:54.114811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76ec61-693d-469a-9e30-26e4c2b74ee0 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:54.119089 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:54.119767 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:54.120206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:54.120515 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:54.185549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:54.187899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:54.202246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1373/2760] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:55.726944 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745ac19-871f-4295-a992-f990ff13649b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:55.728475 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1745ac19-871f-4295-a992-f990ff13649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:53:55.741753 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745ac19-871f-4295-a992-f990ff13649b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:55.746294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:55.746939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:55.747259 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:55.747536 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:55.809431 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:55.810874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:55.819998 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1388/2761] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:53:56.355172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:53:56.364137 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ac1d6-b357-43ac-b5a6-ad73f1e1219c service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:53:56.368071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ba80d-0d8c-41ed-8057-8b35cfa114a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:53:56.368713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba80d-0d8c-41ed-8057-8b35cfa114a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:53:56.369016 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba80d-0d8c-41ed-8057-8b35cfa114a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:53:56.369283 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba80d-0d8c-41ed-8057-8b35cfa114a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:53:56.378394 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba80d-0d8c-41ed-8057-8b35cfa114a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:53:56.379875 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba80d-0d8c-41ed-8057-8b35cfa114a6 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:53:56.390623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1374/2762] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:53:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:03.465444 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:03.531700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc4c5f-e25c-448d-ab73-93f3efe49935 service cinder] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:03.536949 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:03.538130 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:03.538477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:03.538799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] PATH_INFO: `/v3/users/bd4f42cd6697491ea5f1f3693daf0c95` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:03.540019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4f42cd6697491ea5f1f3693daf0c95)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:03.541965 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:03.582061 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:03.591643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4f42cd6697491ea5f1f3693daf0c95'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:03.592330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4f42cd6697491ea5f1f3693daf0c95'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:03.592952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4f42cd6697491ea5f1f3693daf0c95'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:03.602506 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4f42cd6697491ea5f1f3693daf0c95'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:03.614266 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4f42cd6697491ea5f1f3693daf0c95'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:03.626555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1389/2763] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:03 2022] DELETE /identity/v3/users/bd4f42cd6697491ea5f1f3693daf0c95 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:03.632317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:03.632809 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:03.632904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:03.651103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:03.652338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:03.698373 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:03.716937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1375/2764] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:54:03.727043 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:03.728647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:03.786493 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd63de6-cf2c-4f60-ae17-de67fe776a6c admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:03.791201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:03.791868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:03.792145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:03.792417 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:03.806636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:03.808581 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:03.818452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1390/2765] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:04.105366 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:04.107065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:04.119885 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4505cbc-3eb4-475d-b4cc-c8c5e519a3d1 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:04.126142 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:04.127108 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:04.127349 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:04.127602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] PATH_INFO: `/v3/projects/f34b73b9b08c4ae48d4ba6d9ab94ba9b` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:04.128798 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34b73b9b08c4ae48d4ba6d9ab94ba9b)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:04.130719 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:04.182434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34b73b9b08c4ae48d4ba6d9ab94ba9b', 'request_id': 'req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.189012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34b73b9b08c4ae48d4ba6d9ab94ba9b', 'request_id': 'req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.195387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34b73b9b08c4ae48d4ba6d9ab94ba9b', 'request_id': 'req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.208688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] The token cache is being invalidate because project f34b73b9b08c4ae48d4ba6d9ab94ba9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:04.208977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.209585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.211215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1376/2766] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:04 2022] DELETE /identity/v3/projects/f34b73b9b08c4ae48d4ba6d9ab94ba9b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:04.215330 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:04.224794 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffa89a-e8e8-4b44-8e78-78e21abff74f service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:04.283275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:04.284196 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:04.284472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:04.284742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] PATH_INFO: `/v3/users/f12e3eaa04224c48a8c2fa638a71f730` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:04.285980 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12e3eaa04224c48a8c2fa638a71f730)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:04.288258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:04.336610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12e3eaa04224c48a8c2fa638a71f730'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.337339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12e3eaa04224c48a8c2fa638a71f730'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.338025 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12e3eaa04224c48a8c2fa638a71f730'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.346511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12e3eaa04224c48a8c2fa638a71f730'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.351491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:04.361636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12e3eaa04224c48a8c2fa638a71f730'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.375290 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1391/2767] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:04 2022] DELETE /identity/v3/users/f12e3eaa04224c48a8c2fa638a71f730 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:04.655262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:04.656759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:04.670364 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9766289-c403-4a6d-9e20-2ecf3b3f57e4 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:04.726669 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:04.727457 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:04.727757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:04.728039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] PATH_INFO: `/v3/projects/7b04f4a05b0b4355ba99d2c4879fa9e3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:04.729210 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b04f4a05b0b4355ba99d2c4879fa9e3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:04.731230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:04.780168 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b04f4a05b0b4355ba99d2c4879fa9e3', 'request_id': 'req-eed88fce-0272-4e73-ac3c-901ca8a2fff6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.787448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b04f4a05b0b4355ba99d2c4879fa9e3', 'request_id': 'req-eed88fce-0272-4e73-ac3c-901ca8a2fff6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.793563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b04f4a05b0b4355ba99d2c4879fa9e3', 'request_id': 'req-eed88fce-0272-4e73-ac3c-901ca8a2fff6'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.807523 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] The token cache is being invalidate because project 7b04f4a05b0b4355ba99d2c4879fa9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:04.807811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.808516 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.810146 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1377/2768] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:04 2022] DELETE /identity/v3/projects/7b04f4a05b0b4355ba99d2c4879fa9e3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:04.814259 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:04.815799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:04.829176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a93138-53a0-437a-8738-69e8d3895725 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:04.885365 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:04.886235 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:04.886514 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:04.886872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] PATH_INFO: `/v3/users/89f3598e12954a64923e4e2c1072f775` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:04.888104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f3598e12954a64923e4e2c1072f775)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:04.890036 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:04.947396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f3598e12954a64923e4e2c1072f775'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.948197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f3598e12954a64923e4e2c1072f775'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.949123 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f3598e12954a64923e4e2c1072f775'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.957947 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f3598e12954a64923e4e2c1072f775'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.970088 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b78380c9-7263-4632-a607-11180973b442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f3598e12954a64923e4e2c1072f775'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:04.982275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1392/2769] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:04 2022] DELETE /identity/v3/users/89f3598e12954a64923e4e2c1072f775 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:05.257604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.259064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:05.266851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:05.274520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed88fce-0272-4e73-ac3c-901ca8a2fff6 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.334752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.335670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.335946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.336212 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] PATH_INFO: `/v3/projects/7bab305a4f9b45e386338e53048e4a3f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.337422 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bab305a4f9b45e386338e53048e4a3f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.339381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.397433 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bab305a4f9b45e386338e53048e4a3f', 'request_id': 'req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:05.403890 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bab305a4f9b45e386338e53048e4a3f', 'request_id': 'req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:05.410243 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bab305a4f9b45e386338e53048e4a3f', 'request_id': 'req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:05.424895 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] The token cache is being invalidate because project 7bab305a4f9b45e386338e53048e4a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:05.425189 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:05.425847 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6ec1a3c4-7536-4aa1-9d91-75e5e355a9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:05.427481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1378/2770] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:05 2022] DELETE /identity/v3/projects/7bab305a4f9b45e386338e53048e4a3f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:05.433891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.434176 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.434456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.452875 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:05.454062 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:05.503940 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:05.522781 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1393/2771] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:05.524596 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.524883 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.525160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.544680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:05.546011 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:05.554782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1379/2772] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:05.564867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.569074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ab538-e6f1-4190-ad3a-2a0d37437328 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.573737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.574422 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.574694 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.574960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.575708 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:05.576011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.577613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.590057 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1394/2773] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:05.594429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.603770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b7741-0707-4030-ac79-0ce43a4c24e6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.608570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.609222 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.609504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.609776 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.610472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.612520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.650582 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.652254 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1380/2774] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:05 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:05.666189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5ba16-369c-446f-938f-0c5b876e6a81 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.724923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.725699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.726047 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.726421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.727251 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.729258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.749181 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1395/2775] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:05 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:05.753195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.765659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fb4ef-bf51-47c0-9204-f74768bd9c6f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.771195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.771901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.772206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.772504 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.773300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.775031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.785961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1381/2776] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:05.790792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.801539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949c78e-c43c-47b1-a39e-d4ddd352ca35 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.806543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d5660-a88e-43e0-9c92-35090991a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.807329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5660-a88e-43e0-9c92-35090991a0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.807679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5660-a88e-43e0-9c92-35090991a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.807985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d5660-a88e-43e0-9c92-35090991a0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.808780 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5660-a88e-43e0-9c92-35090991a0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.810398 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d5660-a88e-43e0-9c92-35090991a0ca admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.826572 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1396/2777] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:54:05.831181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:05.844338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35afe7-bca8-4fec-a87e-32288af141bd admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:05.850722 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:05.851987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.852390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.852987 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] PATH_INFO: `/v3/projects/0294f5bf447844a395690818baae41bb/users/359d56f4665444ae95ef1839393a4572/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.875639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0294f5bf447844a395690818baae41bb, user_id=359d56f4665444ae95ef1839393a4572, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:05.878409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:05.893583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1382/2778] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:05 2022] PUT /identity/v3/projects/0294f5bf447844a395690818baae41bb/users/359d56f4665444ae95ef1839393a4572/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:05.904108 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:05.904397 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:05.904673 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:05.933237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] MFA Rules not processed for user `359d56f4665444ae95ef1839393a4572`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:05.934560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:06.001386 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1397/2779] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:06.013375 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:06.015084 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:06.047481 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:06.076055 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9aa55-9361-4ff5-a5dd-19115f667718 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:06.079869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb5c59-c59c-4aa3-8ce4-fb66391da971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:06.081459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5c59-c59c-4aa3-8ce4-fb66391da971 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:06.081459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5c59-c59c-4aa3-8ce4-fb66391da971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:06.081459 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb5c59-c59c-4aa3-8ce4-fb66391da971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:06.089874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb5c59-c59c-4aa3-8ce4-fb66391da971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:06.091409 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb5c59-c59c-4aa3-8ce4-fb66391da971 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:06.100493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1383/2780] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:14.706048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:14.708012 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:14.766364 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:14.782591 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9293512-3e3c-4e99-aa58-3b5c3918bc07 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:14.787834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:14.788729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:14.789010 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:14.789284 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] PATH_INFO: `/v3/users/af035faf4fbe4a7e96b1f9ebadc0beb8` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:14.790538 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af035faf4fbe4a7e96b1f9ebadc0beb8)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:14.792573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:14.840197 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af035faf4fbe4a7e96b1f9ebadc0beb8'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:14.840843 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af035faf4fbe4a7e96b1f9ebadc0beb8'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:14.841478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af035faf4fbe4a7e96b1f9ebadc0beb8'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:14.850239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af035faf4fbe4a7e96b1f9ebadc0beb8'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:14.863331 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af035faf4fbe4a7e96b1f9ebadc0beb8'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:14.875928 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1398/2781] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:14 2022] DELETE /identity/v3/users/af035faf4fbe4a7e96b1f9ebadc0beb8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:14.880740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:14.881178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:14.881430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:14.901706 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:14.902989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:14.967642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1384/2782] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:14.979068 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:14.980606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:15.040184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467275a-0691-4e87-8ed3-26f3a25f6c7e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.044186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b51fdcf-49a3-47e4-aa45-18427ae0e29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.045024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51fdcf-49a3-47e4-aa45-18427ae0e29d service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.045392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51fdcf-49a3-47e4-aa45-18427ae0e29d service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.045732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b51fdcf-49a3-47e4-aa45-18427ae0e29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.057809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51fdcf-49a3-47e4-aa45-18427ae0e29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.059599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b51fdcf-49a3-47e4-aa45-18427ae0e29d service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.085644 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1399/2783] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:15.366058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.367755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:15.380785 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6d21b-f88f-48a3-abc6-293b653f4501 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.386239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.387264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.387559 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.387839 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] PATH_INFO: `/v3/projects/0ff6289cbb0b46d88c74a17dfa46ecd3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.389073 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff6289cbb0b46d88c74a17dfa46ecd3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.391187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.449912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff6289cbb0b46d88c74a17dfa46ecd3', 'request_id': 'req-5bff8ae4-349f-439e-b1db-92f78db26881'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:15.456152 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff6289cbb0b46d88c74a17dfa46ecd3', 'request_id': 'req-5bff8ae4-349f-439e-b1db-92f78db26881'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:15.462136 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff6289cbb0b46d88c74a17dfa46ecd3', 'request_id': 'req-5bff8ae4-349f-439e-b1db-92f78db26881'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:15.476414 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] The token cache is being invalidate because project 0ff6289cbb0b46d88c74a17dfa46ecd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:15.476696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:15.477543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-5bff8ae4-349f-439e-b1db-92f78db26881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:15.479208 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1385/2784] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:15 2022] DELETE /identity/v3/projects/0ff6289cbb0b46d88c74a17dfa46ecd3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:15.484287 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.484578 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.484856 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.502508 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:15.504083 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:15.565182 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1400/2785] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:15.572968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.573258 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.573538 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.594985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:15.596764 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:15.609598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1386/2786] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:15.615335 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.626216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b93e3-9d66-4011-90ab-fa2a5273b2f4 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.630956 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.631632 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.631985 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.632289 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.633039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:15.633340 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.634977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.643819 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:15.647705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1401/2787] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:15.652472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.661789 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12bc8f-5b50-47b1-8286-ea0ee0425891 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.667132 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.667904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.668184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.668452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.669133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.671034 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.697930 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1387/2788] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:15.702112 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.711877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401928-8ffb-4a19-945a-bd40a785b2ee admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.782350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.783064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.783394 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.783672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.784376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.786346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.808606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1402/2789] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:15.813968 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.825628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129525a-46ac-4b75-833a-1f268ac88c30 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.831341 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.832023 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.832300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.832570 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.833300 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.834917 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.846249 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1388/2790] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:15.850679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.862893 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb5e9-cd70-45b7-9e28-8b6da2298f48 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.868639 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2537460-42ab-4e40-9f7f-13984cd43611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.869293 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2537460-42ab-4e40-9f7f-13984cd43611 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.869573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2537460-42ab-4e40-9f7f-13984cd43611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.869846 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2537460-42ab-4e40-9f7f-13984cd43611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.870564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2537460-42ab-4e40-9f7f-13984cd43611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.872345 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2537460-42ab-4e40-9f7f-13984cd43611 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.882651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1403/2791] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:15.887486 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:15.901311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35924ed9-5c4e-48bc-8b2c-2435e96b9aba admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:15.906665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:15.907589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.907879 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.908160 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] PATH_INFO: `/v3/projects/29cb67b724f14c96ac9e946ab5b7002a/users/13fbb90328e248c49a15887541bb9db6/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.920821 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:15.924396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cb67b724f14c96ac9e946ab5b7002a, user_id=13fbb90328e248c49a15887541bb9db6, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:15.927484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:15.942190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1389/2792] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:15 2022] PUT /identity/v3/projects/29cb67b724f14c96ac9e946ab5b7002a/users/13fbb90328e248c49a15887541bb9db6/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:15.952851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:15.953126 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:15.953415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:15.982198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] MFA Rules not processed for user `13fbb90328e248c49a15887541bb9db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:15.983497 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:16.048742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1404/2793] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:16.059976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.061795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:16.124040 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91ae9b-991f-4da0-bb03-28470463e628 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.129417 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473574f-13f9-4ae3-acdc-6a66cfd5036b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.130103 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473574f-13f9-4ae3-acdc-6a66cfd5036b service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.130381 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473574f-13f9-4ae3-acdc-6a66cfd5036b service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.130651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473574f-13f9-4ae3-acdc-6a66cfd5036b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.139735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473574f-13f9-4ae3-acdc-6a66cfd5036b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.141176 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473574f-13f9-4ae3-acdc-6a66cfd5036b service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.150133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1390/2794] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:16.174805 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.247004 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de15171-d4b7-470a-882b-6e5ea741af5b None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.252256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.253138 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.253423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.253700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] PATH_INFO: `/v3/users/13fbb90328e248c49a15887541bb9db6` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.254896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fbb90328e248c49a15887541bb9db6)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.256904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.267030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:16.305005 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fbb90328e248c49a15887541bb9db6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.305657 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fbb90328e248c49a15887541bb9db6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.306254 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fbb90328e248c49a15887541bb9db6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.314376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fbb90328e248c49a15887541bb9db6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.326216 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fbb90328e248c49a15887541bb9db6'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.338054 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1405/2795] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:16 2022] DELETE /identity/v3/users/13fbb90328e248c49a15887541bb9db6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:16.342893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.343184 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.343476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.361994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:16.363262 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:16.425577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1391/2796] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:16.435373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.437033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:16.502421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec67b64-4dd6-4ca4-b570-56fa985f9fed admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.507031 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd19889-1bb1-4b2d-82e6-9d858f24bb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.507707 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19889-1bb1-4b2d-82e6-9d858f24bb7f service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.507986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19889-1bb1-4b2d-82e6-9d858f24bb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.508256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd19889-1bb1-4b2d-82e6-9d858f24bb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.519496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19889-1bb1-4b2d-82e6-9d858f24bb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.520920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd19889-1bb1-4b2d-82e6-9d858f24bb7f service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.530356 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1406/2797] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:54:16.813923 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:16.815376 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:16.828479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee003bdb-9724-4d82-8f93-40ae9ec04b52 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:16.837548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:16.838864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.839267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.839477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] PATH_INFO: `/v3/projects/29cb67b724f14c96ac9e946ab5b7002a` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.840840 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cb67b724f14c96ac9e946ab5b7002a)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:16.842788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:16.894174 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cb67b724f14c96ac9e946ab5b7002a', 'request_id': 'req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.900460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cb67b724f14c96ac9e946ab5b7002a', 'request_id': 'req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.906241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cb67b724f14c96ac9e946ab5b7002a', 'request_id': 'req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.922020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] The token cache is being invalidate because project 29cb67b724f14c96ac9e946ab5b7002a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:16.922497 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.923248 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-a9d2c795-16d5-4a1b-8324-0f32ca59b0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:16.925264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1392/2798] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:16 2022] DELETE /identity/v3/projects/29cb67b724f14c96ac9e946ab5b7002a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:16.930458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:16.930914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:16.931020 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:16.949595 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:16.950791 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:17.011011 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1407/2799] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:54:17.020018 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.020324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.020602 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.039190 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:17.040392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:17.048949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1393/2800] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:17.053842 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.065823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ac47c-53dc-4806-8fe8-615165bb8b47 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.070915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.071623 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.071901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.072174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.072887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:17.073199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.074836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.087351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1408/2801] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:17.092106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.101312 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256f696-652b-4ef4-ade7-4a5466e41c0d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.107251 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.107931 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.108213 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.108513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.109182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.111127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.120223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:17.139357 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1394/2802] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:17 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:17.143643 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.153596 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3a302-e444-41ef-9084-e4ac9bde0971 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.166700 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:17.213188 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.213872 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.214153 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.214425 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.215194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.217114 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.238892 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1409/2803] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:17 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:17.243027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.253830 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06856d-41af-4253-8d16-d6eb3d05e477 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.258835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.259530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.259810 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.260079 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.260803 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.262487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.273598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1395/2804] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:17.278650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.289165 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a29d3e-51ad-47ca-9077-7ea183b90f7e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.294285 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653baa6e-f5de-4c2d-926a-249049258cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.295186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653baa6e-f5de-4c2d-926a-249049258cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.295495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653baa6e-f5de-4c2d-926a-249049258cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.295761 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653baa6e-f5de-4c2d-926a-249049258cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.296495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653baa6e-f5de-4c2d-926a-249049258cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.298157 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653baa6e-f5de-4c2d-926a-249049258cf5 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.308445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1410/2805] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:17.312510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.322605 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a85cc-4244-42be-85e4-6f2e8ff0b032 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.327478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.328351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.328630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.328900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] PATH_INFO: `/v3/projects/f4ec46474b514eab977d587d3e592353/users/a2c55c9acb624f168a4090e6ed1e8abd/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.343909 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ec46474b514eab977d587d3e592353, user_id=a2c55c9acb624f168a4090e6ed1e8abd, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.346607 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.362905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1396/2806] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:17 2022] PUT /identity/v3/projects/f4ec46474b514eab977d587d3e592353/users/a2c55c9acb624f168a4090e6ed1e8abd/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:17.374265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248efe-7b33-4370-993d-0a0d42c81199 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.374626 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248efe-7b33-4370-993d-0a0d42c81199 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.374960 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248efe-7b33-4370-993d-0a0d42c81199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.406071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-eb248efe-7b33-4370-993d-0a0d42c81199 None None] MFA Rules not processed for user `a2c55c9acb624f168a4090e6ed1e8abd`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:17.407339 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-eb248efe-7b33-4370-993d-0a0d42c81199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:17.473810 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1411/2807] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:17.485232 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:17.487211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:17.554914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2511-0664-44af-9ec2-60c4a022b288 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:17.560115 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:17.561064 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:17.561419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:17.561758 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:17.575350 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:17.576808 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:17.586276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1397/2808] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:18.962779 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:18.963336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:18.963336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:18.984689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] MFA Rules not processed for user `a2c55c9acb624f168a4090e6ed1e8abd`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:18.985895 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:18.994033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1412/2809] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:54:19.466493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:19.468221 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:19.562351 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcefb25-22a1-4c40-9b69-e4185d028aeb service cinder] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:19.567448 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:19.568095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:19.568374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:19.568650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:19.570568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:19.582623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:19.584302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:19.595309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1398/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:21.570898 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:21.572413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:21.634329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4585a49-9bd2-44b5-aba0-4a497e6db43d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:21.638635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:21.639060 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:21.639373 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:21.639649 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:21.641474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:21.651760 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:21.653350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad642a-3306-468b-998e-7026096a84c6 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:21.663205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1413/2811] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:28.344060 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:28.346698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:28.398133 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:28.424467 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2640-05bf-4ab5-933d-d2b934390d2b service placement] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:28.430092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff4b9a16037c4657bd7710297746ad4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:28.430746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:28.431030 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:28.431346 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:28.433274 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:28.445348 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:28.446962 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:28.457938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1399/2812] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:31.657877 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:35.133360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bde4-52bf-412c-a5ff-3c41b7c0079f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.133933 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bde4-52bf-412c-a5ff-3c41b7c0079f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.134058 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7bde4-52bf-412c-a5ff-3c41b7c0079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:35.213392 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-f3f7bde4-52bf-412c-a5ff-3c41b7c0079f None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:35.215870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-f3f7bde4-52bf-412c-a5ff-3c41b7c0079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:35.288039 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1414/2813] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:54:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:35.337900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:35.339685 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:35.437429 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848f8ca-9824-4192-a3e6-5a39a07a94e6 service nova] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:35.443127 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:35.443869 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.444155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.444430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:35.452838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:35.454438 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:35.462518 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1400/2814] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:54:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 16:54:35.983210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226b1d-b457-48b5-9093-d81cade36bed None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:35.983510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226b1d-b457-48b5-9093-d81cade36bed None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:35.983783 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226b1d-b457-48b5-9093-d81cade36bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.002718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-08226b1d-b457-48b5-9093-d81cade36bed None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:36.003953 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-08226b1d-b457-48b5-9093-d81cade36bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:36.012003 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1415/2815] 10.222.0.45 () {58 vars in 967 bytes} [Wed May 25 16:54:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:36.023975 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.034905 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b12d5-ff5b-435c-8962-c57daeae7be5 service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.040688 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.041322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.041597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.041866 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.049820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:36.051449 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:36.059256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1401/2816] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:54:36.271982 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60317a-d5f8-4f2e-a6e9-585202e9dd03 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.272449 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60317a-d5f8-4f2e-a6e9-585202e9dd03 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.272519 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60317a-d5f8-4f2e-a6e9-585202e9dd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.298368 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-5a60317a-d5f8-4f2e-a6e9-585202e9dd03 None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:36.299599 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-5a60317a-d5f8-4f2e-a6e9-585202e9dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:36.307070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1416/2817] 10.222.0.45 () {58 vars in 1009 bytes} [Wed May 25 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:36.319048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.330056 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afbcaf-5ed0-4eae-a261-c0ec945b0aeb service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.335148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.335817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.336101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.336405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.344755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:36.346294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:36.354465 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1402/2818] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:54:36.689507 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.689808 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.690084 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.707912 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] MFA Rules not processed for user `e28dd040159544d7a4ce050fa593dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:36.709111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:36.717669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1417/2819] 10.222.0.45 () {58 vars in 967 bytes} [Wed May 25 16:54:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:36.730514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:36.745874 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871193f4-a462-44be-82d0-975c0fd40e63 service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:36.752353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55b74ae1f54fbd81f9459c12f0e10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:36.752990 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:36.753268 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:36.753534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:36.762944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:36.764583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:36.772832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1403/2820] 10.222.0.45 () {60 vars in 1384 bytes} [Wed May 25 16:54:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 16:54:37.410169 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:37.411676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:37.427866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf50785-3ece-4f73-91c2-abe20faa2702 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:37.431924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:37.432583 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:37.432919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:37.433199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:37.434995 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:37.500749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:37.502360 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece86ad1-a1f0-4abd-8aaa-571fa4567325 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:37.512491 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1418/2821] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:38.894234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:38.906450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b946c-b0d9-4d9a-bfc7-0744c5bcb099 service swift] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:38.911628 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:38.912963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:38.913242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:38.913514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] PATH_INFO: `/v3/users/a2c55c9acb624f168a4090e6ed1e8abd` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:38.914713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c55c9acb624f168a4090e6ed1e8abd)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:38.916680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:38.987081 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c55c9acb624f168a4090e6ed1e8abd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:38.998105 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c55c9acb624f168a4090e6ed1e8abd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.000082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c55c9acb624f168a4090e6ed1e8abd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.000900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c55c9acb624f168a4090e6ed1e8abd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.003524 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:39.019288 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c55c9acb624f168a4090e6ed1e8abd'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.033732 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1404/2822] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:38 2022] DELETE /identity/v3/users/a2c55c9acb624f168a4090e6ed1e8abd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:39.038658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac430-b464-42aa-b926-07be0670990f None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.039170 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac430-b464-42aa-b926-07be0670990f None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.039252 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac430-b464-42aa-b926-07be0670990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.069288 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-46fac430-b464-42aa-b926-07be0670990f None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:39.070742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-46fac430-b464-42aa-b926-07be0670990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:39.099336 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=100 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:39.137059 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1419/2823] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:39.146728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.148520 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:39.225503 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8e996-c1ae-48fb-a35f-863460ffa6de admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.230291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.231287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.231724 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.232119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.242542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.244154 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.254461 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1405/2824] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 16:54:39.455935 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac430-b464-42aa-b926-07be0670990f None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:39.458414 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-46fac430-b464-42aa-b926-07be0670990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:39.475967 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac430-b464-42aa-b926-07be0670990f None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:39.480789 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:39.481840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:39.482279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:39.482824 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] PATH_INFO: `/v3/projects/f4ec46474b514eab977d587d3e592353` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:39.484486 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ec46474b514eab977d587d3e592353)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:39.489542 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:39.547775 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ec46474b514eab977d587d3e592353', 'request_id': 'req-c4111b33-5c88-4e08-9b99-fadf36a68fa2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.554756 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ec46474b514eab977d587d3e592353', 'request_id': 'req-c4111b33-5c88-4e08-9b99-fadf36a68fa2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.560851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ec46474b514eab977d587d3e592353', 'request_id': 'req-c4111b33-5c88-4e08-9b99-fadf36a68fa2'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.575412 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] The token cache is being invalidate because project f4ec46474b514eab977d587d3e592353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:39.575723 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.576319 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:39.577865 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1420/2825] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:39 2022] DELETE /identity/v3/projects/f4ec46474b514eab977d587d3e592353 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:40.535914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:40.537687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:40.553475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e08fc-7e57-4b30-9fb2-d8c5bf76f75c service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:40.610680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:40.611599 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:40.611878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:40.612149 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] PATH_INFO: `/v3/users/a0c9f3f10fd142439521e4b36cf33157` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:40.613411 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c9f3f10fd142439521e4b36cf33157)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:40.615444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:40.665452 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c9f3f10fd142439521e4b36cf33157'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:40.674774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c9f3f10fd142439521e4b36cf33157'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:40.675630 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c9f3f10fd142439521e4b36cf33157'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:40.676522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c9f3f10fd142439521e4b36cf33157'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:40.691590 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6f658d74-2245-40ac-b73b-e3977c3c7990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c9f3f10fd142439521e4b36cf33157'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:40.697892 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:40.706884 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1406/2826] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:40 2022] DELETE /identity/v3/users/a0c9f3f10fd142439521e4b36cf33157 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:40.881329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:40.882871 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:40.897173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4111b33-5c88-4e08-9b99-fadf36a68fa2 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:40.960580 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:40.961513 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:40.961815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:40.962111 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] PATH_INFO: `/v3/projects/ec1d676becac4112a7c0c319e54b2cd2` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:40.963351 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1d676becac4112a7c0c319e54b2cd2)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:40.965362 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.017167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1d676becac4112a7c0c319e54b2cd2', 'request_id': 'req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:41.023452 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1d676becac4112a7c0c319e54b2cd2', 'request_id': 'req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:41.025453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:41.030002 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1d676becac4112a7c0c319e54b2cd2', 'request_id': 'req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:41.043854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] The token cache is being invalidate because project ec1d676becac4112a7c0c319e54b2cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:41.044162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:41.044762 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-f5c53bcd-77f8-4bdf-a33f-5cb3714c0bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:41.046306 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1421/2827] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:40 2022] DELETE /identity/v3/projects/ec1d676becac4112a7c0c319e54b2cd2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:41.052941 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.053224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.053500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.105216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:41.106451 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:41.170754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1407/2828] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:41.178703 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.178915 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.179263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.198854 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:41.200089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:41.208646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1422/2829] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:41.213157 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.229107 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb34f4-f365-45c6-ba35-9d15ac30fe2c None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.233904 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.234600 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.234880 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.235246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.235937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:41.236287 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.237925 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.254392 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1408/2830] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 16:54:41.257225 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.267253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d91248-974b-4543-b38b-ab1552f1cf67 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.272676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.273348 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.273658 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.273919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.274614 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.276689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.313314 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1423/2831] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:41 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:41.317493 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.327566 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5832800-3f21-48b2-8b53-451f261b6bd1 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.389321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.390019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.390308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.390589 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.391332 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.393265 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.415751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1409/2832] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:41 2022] POST /identity/v3/users => generated 302 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:41.419971 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.431078 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee970c27-59f4-4a9c-a298-44e10ee60fb2 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.436186 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.436883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.437166 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.437445 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.438189 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.439989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.450913 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1424/2833] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:41.454873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.466824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07cb29-e660-420f-b5fe-c06493d57c5f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.472450 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a276367-7a9f-4da0-a26e-8e334252c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.473101 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a276367-7a9f-4da0-a26e-8e334252c834 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.473458 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a276367-7a9f-4da0-a26e-8e334252c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.473878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a276367-7a9f-4da0-a26e-8e334252c834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.474584 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a276367-7a9f-4da0-a26e-8e334252c834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.476356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a276367-7a9f-4da0-a26e-8e334252c834 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.486938 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1410/2834] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:54:41.491308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.502555 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4424-119d-4f16-aeb6-3fd57b925a81 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.507526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.508413 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.508699 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.508970 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] PATH_INFO: `/v3/projects/989fd7c689dd45008ff226b95be23c0c/users/a1f2e72554c543d9b4e2614c0231b73b/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.524403 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989fd7c689dd45008ff226b95be23c0c, user_id=a1f2e72554c543d9b4e2614c0231b73b, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.528646 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.546662 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1425/2835] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:41 2022] PUT /identity/v3/projects/989fd7c689dd45008ff226b95be23c0c/users/a1f2e72554c543d9b4e2614c0231b73b/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:41.551832 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb68383-30a8-4391-a627-941b3a796224 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.552276 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb68383-30a8-4391-a627-941b3a796224 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.552454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb68383-30a8-4391-a627-941b3a796224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.570050 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-bbb68383-30a8-4391-a627-941b3a796224 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:41.571273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-bbb68383-30a8-4391-a627-941b3a796224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:41.605271 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:41.632389 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1411/2836] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:41.642377 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:41.644281 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:41.705103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fec91-f5b9-466d-a7ae-46b262b3ce95 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:41.709275 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:41.709914 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:41.710194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:41.710461 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:41.721510 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:41.722945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:41.732527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1426/2837] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:42.366583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.366873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.367148 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.399093 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] MFA Rules not processed for user `a1f2e72554c543d9b4e2614c0231b73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:42.400485 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:42.469304 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1412/2838] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:42.473876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.484357 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72328c16-45a6-47dd-923c-5320b1373fad service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.489439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.490069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.490363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.490654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.491396 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.493367 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.520742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1427/2839] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:42 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:42.525240 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.537490 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f70830-e2ce-4407-a0d6-db6757442772 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.599545 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.600234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.600522 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.600794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.601487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.603456 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.626076 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1413/2840] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:42 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:42.630159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.640530 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ee231-5fbd-4a0e-bb68-c37ef32ba5aa admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.645093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.645797 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.646081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.646374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.647175 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.648798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.659466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1428/2841] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:42.664259 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.674674 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff505978-cc36-40d9-9de2-f3bb2ee1a703 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.680295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.681187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.681470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.681743 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] PATH_INFO: `/v3/projects/08f1be0e93ce4253b0c564afb8c95303/users/cd49f292e81248358c84e41dfa55076b/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.697534 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f1be0e93ce4253b0c564afb8c95303, user_id=cd49f292e81248358c84e41dfa55076b, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.700562 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.718548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1414/2842] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:42 2022] PUT /identity/v3/projects/08f1be0e93ce4253b0c564afb8c95303/users/cd49f292e81248358c84e41dfa55076b/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:42.722771 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.732891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb2371-81b7-4e0d-a36c-0fc0e0c0610e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.773610 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:42.791329 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.791993 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.792272 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.792546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.793265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.794868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.804744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1429/2843] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:42.809838 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:42.825824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efa44e-45cb-4941-9642-96f769365245 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:42.834061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ff02b-34c6-4173-8bad-530d82d85622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:42.834976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ff02b-34c6-4173-8bad-530d82d85622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:42.835388 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ff02b-34c6-4173-8bad-530d82d85622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:42.835714 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ff02b-34c6-4173-8bad-530d82d85622 admin admin] PATH_INFO: `/v3/projects/08f1be0e93ce4253b0c564afb8c95303/users/cd49f292e81248358c84e41dfa55076b/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:42.839063 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ff02b-34c6-4173-8bad-530d82d85622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f1be0e93ce4253b0c564afb8c95303, user_id=cd49f292e81248358c84e41dfa55076b, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:42.841993 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ff02b-34c6-4173-8bad-530d82d85622 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:42.852949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1415/2844] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:42 2022] PUT /identity/v3/projects/08f1be0e93ce4253b0c564afb8c95303/users/cd49f292e81248358c84e41dfa55076b/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:43.455716 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.457880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:43.471355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9037-72b3-4cd0-ac78-b45e42187fa9 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.507576 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106c2e-4708-4919-a554-6f6b95a261a2 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.507790 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106c2e-4708-4919-a554-6f6b95a261a2 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.508061 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106c2e-4708-4919-a554-6f6b95a261a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.534648 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.535660 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.535952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.536279 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] PATH_INFO: `/v3/users/359d56f4665444ae95ef1839393a4572` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.537897 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=359d56f4665444ae95ef1839393a4572)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:43.539884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:43.541563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-cf106c2e-4708-4919-a554-6f6b95a261a2 None None] MFA Rules not processed for user `cd49f292e81248358c84e41dfa55076b`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:43.543529 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-cf106c2e-4708-4919-a554-6f6b95a261a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:43.553372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:43.596661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359d56f4665444ae95ef1839393a4572'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:43.597516 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359d56f4665444ae95ef1839393a4572'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:43.598717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359d56f4665444ae95ef1839393a4572'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:43.608743 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359d56f4665444ae95ef1839393a4572'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:43.621894 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359d56f4665444ae95ef1839393a4572'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:43.633594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1416/2845] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:43.638560 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1430/2846] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:43 2022] DELETE /identity/v3/users/359d56f4665444ae95ef1839393a4572 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:43.640211 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53094-0619-4379-97fc-266044358c5e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.640598 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53094-0619-4379-97fc-266044358c5e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.640882 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53094-0619-4379-97fc-266044358c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.660781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-5fa53094-0619-4379-97fc-266044358c5e None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:43.662552 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5fa53094-0619-4379-97fc-266044358c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:43.726502 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1417/2847] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:43.737291 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:43.738705 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:43.797704 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece3ee6-a65c-4620-8db8-5aedfcf789dc admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:43.801223 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:43.801868 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:43.802141 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:43.802410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:43.811387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:43.812831 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:43.819455 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:43.825836 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1431/2848] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:44.364320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53094-0619-4379-97fc-266044358c5e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.365870 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-5fa53094-0619-4379-97fc-266044358c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:44.378498 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53094-0619-4379-97fc-266044358c5e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:44.383187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:44.384218 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:44.384353 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:44.384665 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] PATH_INFO: `/v3/projects/0294f5bf447844a395690818baae41bb` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:44.386059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0294f5bf447844a395690818baae41bb)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:44.387934 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:44.444198 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0294f5bf447844a395690818baae41bb', 'request_id': 'req-b6732f22-d98e-42f7-aa95-a6d95aa9708d'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:44.450549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0294f5bf447844a395690818baae41bb', 'request_id': 'req-b6732f22-d98e-42f7-aa95-a6d95aa9708d'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:44.457091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0294f5bf447844a395690818baae41bb', 'request_id': 'req-b6732f22-d98e-42f7-aa95-a6d95aa9708d'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:44.471532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] The token cache is being invalidate because project 0294f5bf447844a395690818baae41bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:44.471822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:44.472469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:44.474439 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1418/2849] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:44 2022] DELETE /identity/v3/projects/0294f5bf447844a395690818baae41bb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:44.948821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:44.950652 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:44.965139 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc09854-0ce0-4f30-859f-e3bdf1847ca3 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.031651 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.032525 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.032799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.033071 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] PATH_INFO: `/v3/users/a1f2e72554c543d9b4e2614c0231b73b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.034295 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f2e72554c543d9b4e2614c0231b73b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.036258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.084961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f2e72554c543d9b4e2614c0231b73b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.085604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f2e72554c543d9b4e2614c0231b73b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.086198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f2e72554c543d9b4e2614c0231b73b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.094695 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f2e72554c543d9b4e2614c0231b73b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.109070 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f2e72554c543d9b4e2614c0231b73b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.122635 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1432/2850] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:44 2022] DELETE /identity/v3/users/a1f2e72554c543d9b4e2614c0231b73b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:45.305763 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.307368 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:45.325206 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6732f22-d98e-42f7-aa95-a6d95aa9708d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.354655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.397604 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.398482 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.398766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.399039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] PATH_INFO: `/v3/projects/989fd7c689dd45008ff226b95be23c0c` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.400257 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=989fd7c689dd45008ff226b95be23c0c)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.402301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.455872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989fd7c689dd45008ff226b95be23c0c', 'request_id': 'req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.462455 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989fd7c689dd45008ff226b95be23c0c', 'request_id': 'req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.468182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989fd7c689dd45008ff226b95be23c0c', 'request_id': 'req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.482273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] The token cache is being invalidate because project 989fd7c689dd45008ff226b95be23c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:45.482583 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.483260 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.484822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1419/2851] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:45 2022] DELETE /identity/v3/projects/989fd7c689dd45008ff226b95be23c0c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:45.488973 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.490472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:45.503729 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a3ad4-e018-442b-af48-7ae50c80fa9f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.566404 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.567311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.567592 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.567867 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] PATH_INFO: `/v3/users/cd49f292e81248358c84e41dfa55076b` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.572258 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd49f292e81248358c84e41dfa55076b)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.574236 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.596604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:45.626618 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd49f292e81248358c84e41dfa55076b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.627312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd49f292e81248358c84e41dfa55076b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.627969 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd49f292e81248358c84e41dfa55076b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.637470 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd49f292e81248358c84e41dfa55076b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.653253 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7d116880-dd09-4bd9-9395-ae7249a80f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd49f292e81248358c84e41dfa55076b'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:45.668749 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1433/2852] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:45 2022] DELETE /identity/v3/users/cd49f292e81248358c84e41dfa55076b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:45.868811 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:45.870378 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:45.883893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ae7cc-d89e-4100-b2d3-3edd770694fb admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:45.943423 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:45.944285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:45.944563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:45.944834 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] PATH_INFO: `/v3/projects/08f1be0e93ce4253b0c564afb8c95303` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:45.946012 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f1be0e93ce4253b0c564afb8c95303)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:45.947973 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:45.996352 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f1be0e93ce4253b0c564afb8c95303', 'request_id': 'req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:46.002687 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f1be0e93ce4253b0c564afb8c95303', 'request_id': 'req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:46.007517 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.009367 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f1be0e93ce4253b0c564afb8c95303', 'request_id': 'req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:46.023543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] The token cache is being invalidate because project 08f1be0e93ce4253b0c564afb8c95303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:46.023826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:46.024443 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-f15e012c-6b52-4c4a-ab3a-3eb7441c1266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:46.026003 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1420/2853] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:45 2022] DELETE /identity/v3/projects/08f1be0e93ce4253b0c564afb8c95303 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:46.031187 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.031656 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.031763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.050549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:46.051840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:46.118411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1434/2854] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:46.128542 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.128695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.128886 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.150117 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:46.151397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:46.159943 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1421/2855] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:46.164663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.174731 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892ec16-c638-46bc-80f7-01536bf0e5e0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.179732 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.180521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.180802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.181081 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.181799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:46.182110 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.183765 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.195587 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1435/2856] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:46.200397 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.214476 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173971d-1d5f-4f8c-bc57-e1a6121c321a None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.220038 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.220691 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.220976 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.221256 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.221949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.223912 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.250835 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1422/2857] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:46.254870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.265064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394bf20-5546-4170-b6e4-03e7ee1abede admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.326939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.327630 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.327905 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.328172 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.328866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.330776 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.351545 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1436/2858] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:46.355726 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.366390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2729c-a6df-499c-8a54-1a770a4df85f admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.371737 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.372400 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.372680 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.372953 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.373698 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.375338 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.386071 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1423/2859] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:46.390024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.400308 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a9e7a-d0f7-4113-b371-9a8783a6f603 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.405509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceb96f-6c43-4ca6-a453-9a0dd6bf6526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.406156 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceb96f-6c43-4ca6-a453-9a0dd6bf6526 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.406429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceb96f-6c43-4ca6-a453-9a0dd6bf6526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.406701 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceb96f-6c43-4ca6-a453-9a0dd6bf6526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.407427 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceb96f-6c43-4ca6-a453-9a0dd6bf6526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.409006 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceb96f-6c43-4ca6-a453-9a0dd6bf6526 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.419557 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1437/2860] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:54:46.424177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.434845 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eeac8-2111-4090-8ede-109d248f2218 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.440059 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.440946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.441234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.441509 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] PATH_INFO: `/v3/projects/f1f095745f934a3cbb4142ebefebf540/users/3dfef2106991412393930908c1df85c9/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.457955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f095745f934a3cbb4142ebefebf540, user_id=3dfef2106991412393930908c1df85c9, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.460663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.477339 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1424/2861] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:46 2022] PUT /identity/v3/projects/f1f095745f934a3cbb4142ebefebf540/users/3dfef2106991412393930908c1df85c9/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:46.487736 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.488024 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.488296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.495527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:46.517072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] MFA Rules not processed for user `3dfef2106991412393930908c1df85c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:46.518294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:46.590521 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1438/2862] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:46.595097 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.659437 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3e0dc-42c1-49db-b22f-8f81bd048d6c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.664795 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.665445 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.665720 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.665988 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.666658 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.668666 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.695661 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1425/2863] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:46.701479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.713566 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d6e2-5564-46dd-821b-3aa72dd8c53d None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.773256 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.773911 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.774190 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.774463 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.775137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.777090 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.801841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1439/2864] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:46 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:46.806141 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.823495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e00931-f0b6-4d02-8b24-5f7870e4c903 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.829326 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.829994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.830273 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.830548 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.831307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.832952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.843980 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1426/2865] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:46.848177 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.859074 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8293656d-c7a7-451f-8604-e5a896b0f82b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.866033 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.867503 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.867920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.868310 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] PATH_INFO: `/v3/projects/f71790444a10499da06cba4c1fac7491/users/7b05c6edb4d74dcab8211d793d947f13/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.885715 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71790444a10499da06cba4c1fac7491, user_id=7b05c6edb4d74dcab8211d793d947f13, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.888471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.908733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1440/2866] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:46 2022] PUT /identity/v3/projects/f71790444a10499da06cba4c1fac7491/users/7b05c6edb4d74dcab8211d793d947f13/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:46.913463 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:46.924393 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b229c-5d85-4c45-b83f-86e88b69a5ac admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:46.989049 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ad709-2555-442d-be47-237e571dfef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:46.989746 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad709-2555-442d-be47-237e571dfef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:46.990024 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad709-2555-442d-be47-237e571dfef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:46.990294 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ad709-2555-442d-be47-237e571dfef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:46.991013 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ad709-2555-442d-be47-237e571dfef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:46.992670 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ad709-2555-442d-be47-237e571dfef6 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:46.993995 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.004173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1427/2867] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:47.008423 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.018741 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15943-b763-4623-9491-f72451e3806b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.023939 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.024821 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.025104 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.025376 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] PATH_INFO: `/v3/projects/f71790444a10499da06cba4c1fac7491/users/7b05c6edb4d74dcab8211d793d947f13/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.028160 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f71790444a10499da06cba4c1fac7491, user_id=7b05c6edb4d74dcab8211d793d947f13, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.031806 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.046851 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1441/2868] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:47 2022] PUT /identity/v3/projects/f71790444a10499da06cba4c1fac7491/users/7b05c6edb4d74dcab8211d793d947f13/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:47.057077 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.057363 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.057709 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.086264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] MFA Rules not processed for user `7b05c6edb4d74dcab8211d793d947f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:47.087638 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:47.161755 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1428/2869] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:47.173888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.175942 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:47.230576 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.247072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e826d7-cb60-44a0-83b7-33f9d3f01856 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.250921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6a226-251b-4d89-ab29-403cf877eb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.251619 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a226-251b-4d89-ab29-403cf877eb43 service cinder] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.251927 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a226-251b-4d89-ab29-403cf877eb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.252184 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a226-251b-4d89-ab29-403cf877eb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.261410 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6a226-251b-4d89-ab29-403cf877eb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.262870 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6a226-251b-4d89-ab29-403cf877eb43 service cinder] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.272146 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1442/2870] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:47.679597 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.758106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e58a2a-3dc6-4ba6-9869-47ba46b615b0 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:47.763817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:47.764702 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.764989 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.765267 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] PATH_INFO: `/v3/users/3dfef2106991412393930908c1df85c9` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.766593 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfef2106991412393930908c1df85c9)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:47.768568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:47.819007 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfef2106991412393930908c1df85c9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:47.826549 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfef2106991412393930908c1df85c9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:47.827227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfef2106991412393930908c1df85c9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:47.827873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfef2106991412393930908c1df85c9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:47.840131 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfef2106991412393930908c1df85c9'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:47.848937 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:47.855728 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1429/2871] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:47 2022] DELETE /identity/v3/users/3dfef2106991412393930908c1df85c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:47.860371 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:47.860663 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:47.860941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:47.879378 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:47.880559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:47.951685 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1443/2872] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:47.961901 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:47.964319 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:48.025372 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256d022-9301-4021-b8d9-80093eefa727 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.029806 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.030454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.030738 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.031010 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.040935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.042431 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:48.052343 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1430/2873] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:48.348145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.349792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:48.362647 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6664d-9331-43d9-9818-0070f0c977a7 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.367523 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.368381 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.368668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.368958 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] PATH_INFO: `/v3/projects/f1f095745f934a3cbb4142ebefebf540` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.370297 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f095745f934a3cbb4142ebefebf540)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.372268 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:48.421229 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f095745f934a3cbb4142ebefebf540', 'request_id': 'req-27427b4f-3249-4cb6-8e44-739d592bf55d'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.427323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f095745f934a3cbb4142ebefebf540', 'request_id': 'req-27427b4f-3249-4cb6-8e44-739d592bf55d'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.433641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f095745f934a3cbb4142ebefebf540', 'request_id': 'req-27427b4f-3249-4cb6-8e44-739d592bf55d'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.447802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] The token cache is being invalidate because project f1f095745f934a3cbb4142ebefebf540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:48.448093 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.448852 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.450479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1444/2874] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:48 2022] DELETE /identity/v3/projects/f1f095745f934a3cbb4142ebefebf540 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:48.456484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.469308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafceb2c-7394-4e56-9827-33c4adfa5b76 service neutron] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.528114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.529058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.529344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.529623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] PATH_INFO: `/v3/users/7b05c6edb4d74dcab8211d793d947f13` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.530872 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b05c6edb4d74dcab8211d793d947f13)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.532922 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:48.582194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b05c6edb4d74dcab8211d793d947f13'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.591468 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b05c6edb4d74dcab8211d793d947f13'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.592106 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b05c6edb4d74dcab8211d793d947f13'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.592752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b05c6edb4d74dcab8211d793d947f13'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.604782 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-01c23d7f-2fe1-4929-9a49-0ec21adb0d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b05c6edb4d74dcab8211d793d947f13'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:48.617541 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1431/2875] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:48 2022] DELETE /identity/v3/users/7b05c6edb4d74dcab8211d793d947f13 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:48.914315 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:48.915809 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:48.929462 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27427b4f-3249-4cb6-8e44-739d592bf55d admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:48.992962 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:48.993987 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:48.994387 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:48.994668 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] PATH_INFO: `/v3/projects/f71790444a10499da06cba4c1fac7491` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:48.995874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f71790444a10499da06cba4c1fac7491)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:48.998311 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.005385 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:49.055548 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f71790444a10499da06cba4c1fac7491', 'request_id': 'req-3b75cd13-5133-4b4e-89ec-d994b663bd5a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:49.062265 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f71790444a10499da06cba4c1fac7491', 'request_id': 'req-3b75cd13-5133-4b4e-89ec-d994b663bd5a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:49.067921 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f71790444a10499da06cba4c1fac7491', 'request_id': 'req-3b75cd13-5133-4b4e-89ec-d994b663bd5a'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:49.082086 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] The token cache is being invalidate because project f71790444a10499da06cba4c1fac7491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80441) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:49.082374 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:49.083017 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-3b75cd13-5133-4b4e-89ec-d994b663bd5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:49.090467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1445/2876] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:48 2022] DELETE /identity/v3/projects/f71790444a10499da06cba4c1fac7491 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:49.094048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.094513 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.094588 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.113001 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:49.114355 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:49.134826 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:49.181444 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1432/2877] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:49.190527 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.190818 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.191101 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.209793 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:49.211066 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:49.220263 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1446/2878] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:49.224710 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.235333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5fcee-2a08-4c59-b466-7eca6064e7df None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.240992 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.241705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.242022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.242324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.243194 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80440) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:49.243469 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.245242 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.257299 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1433/2879] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:49.261483 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.270977 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090e16c-9b60-49c4-94ae-742c4fbfee40 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.276769 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.277435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.277713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.277981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.278689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.280688 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.308755 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1447/2880] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:49.313155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.323659 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d7ca-a040-4a3a-9121-be59ebc17d0c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.384762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.385478 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.385752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.386020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.386721 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.388701 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.415495 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1434/2881] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:49.421802 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.432904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5475477-ff4a-4a9b-b786-e822f4cc736f admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.438620 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.439363 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.439680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.439955 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.440734 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.442466 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.455907 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1448/2882] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:49.460291 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.471440 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a140b-ab27-4d2c-9720-65ec5c096a7c admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.476379 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777ac6d-588d-465c-85a5-f01b3740f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.477041 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777ac6d-588d-465c-85a5-f01b3740f85d admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.477321 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777ac6d-588d-465c-85a5-f01b3740f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.477592 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777ac6d-588d-465c-85a5-f01b3740f85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.478307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777ac6d-588d-465c-85a5-f01b3740f85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.480082 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777ac6d-588d-465c-85a5-f01b3740f85d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.491374 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1435/2883] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:49.497813 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.512838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf748ca-5bea-4884-a9c7-7d132cd98114 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.521278 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.522636 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] REQUEST_METHOD: `PUT` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.522981 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.523346 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] PATH_INFO: `/v3/projects/6500597befa843e9944ea280f26fb641/users/c6df0f2182ef4e7b88f5903e6cdfc2dd/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.540474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6500597befa843e9944ea280f26fb641, user_id=c6df0f2182ef4e7b88f5903e6cdfc2dd, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.543140 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.558991 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1449/2884] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:49 2022] PUT /identity/v3/projects/6500597befa843e9944ea280f26fb641/users/c6df0f2182ef4e7b88f5903e6cdfc2dd/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:49.569098 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.569387 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.569663 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.596623 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] MFA Rules not processed for user `c6df0f2182ef4e7b88f5903e6cdfc2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:49.597824 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:49.668446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1436/2885] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:49.673144 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.735067 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40858-3c96-4ef1-8f36-018a7d24c22d admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.739910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.740637 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.740916 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.741192 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] PATH_INFO: `/v3/projects` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.741866 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.743807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.771205 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1450/2886] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:49.777857 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.789095 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f9730-5cfa-413e-b1cc-558731dfa27e None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.803757 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:49.854986 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.855690 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.855971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.856239 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] PATH_INFO: `/v3/users` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.856921 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.858926 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.883836 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1437/2887] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:49 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:49.888158 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.899145 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e4d1e-6362-4dfb-ad8b-e708c277745b admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.905222 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.905881 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.906164 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.906439 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.907193 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.908817 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.920442 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1451/2888] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:49.925053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.940370 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f7b53-d2e9-4098-a3a1-e8a5ac3b01ad admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:49.948033 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:49.949015 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:49.949295 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:49.949553 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] PATH_INFO: `/v3/projects/b346bdf770ed4d0d86f048bc281e11d5/users/c37823e1d8894e5d8e297d1023504712/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:49.964462 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b346bdf770ed4d0d86f048bc281e11d5, user_id=c37823e1d8894e5d8e297d1023504712, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:49.967100 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:49.981942 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1438/2889] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:49 2022] PUT /identity/v3/projects/b346bdf770ed4d0d86f048bc281e11d5/users/c37823e1d8894e5d8e297d1023504712/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:49.987214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:49.993812 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:49.998237 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c1e74-4276-499a-91ca-428b006e0ade admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.056853 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253f62-b4c6-49b6-8f8d-9c00886e1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.057522 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253f62-b4c6-49b6-8f8d-9c00886e1088 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.057837 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253f62-b4c6-49b6-8f8d-9c00886e1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.058100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253f62-b4c6-49b6-8f8d-9c00886e1088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.058832 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253f62-b4c6-49b6-8f8d-9c00886e1088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.060472 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6253f62-b4c6-49b6-8f8d-9c00886e1088 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.071453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1452/2890] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:50.075927 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.086752 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddf8a7-a925-4b8b-96cf-d89717ee779e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.091739 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.092620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.092899 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.093195 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] PATH_INFO: `/v3/projects/b346bdf770ed4d0d86f048bc281e11d5/users/c37823e1d8894e5d8e297d1023504712/roles/3c10f6cfaef84131b248e3c006d4395f` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.095119 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b346bdf770ed4d0d86f048bc281e11d5, user_id=c37823e1d8894e5d8e297d1023504712, role_id=3c10f6cfaef84131b248e3c006d4395f)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.097759 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.108651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1439/2891] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:50 2022] PUT /identity/v3/projects/b346bdf770ed4d0d86f048bc281e11d5/users/c37823e1d8894e5d8e297d1023504712/roles/3c10f6cfaef84131b248e3c006d4395f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:50.119098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.119421 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.119697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.149294 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] MFA Rules not processed for user `c37823e1d8894e5d8e297d1023504712`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:50.150502 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:50.222121 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1453/2892] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:50.233642 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.236384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:50.296322 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c9adc-72b5-4ea4-901e-2f8f194f9bb5 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.301361 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b472ca-0c62-4c31-9d80-2d2536543f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.302005 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b472ca-0c62-4c31-9d80-2d2536543f26 service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.302285 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b472ca-0c62-4c31-9d80-2d2536543f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.302558 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b472ca-0c62-4c31-9d80-2d2536543f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.313480 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b472ca-0c62-4c31-9d80-2d2536543f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.314856 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b472ca-0c62-4c31-9d80-2d2536543f26 service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.324867 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1440/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:50.884137 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:50.949214 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8c291-52af-44a3-a448-e9fb30d968c0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:50.954790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:50.955713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:50.956016 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:50.956286 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] PATH_INFO: `/v3/users/c6df0f2182ef4e7b88f5903e6cdfc2dd` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:50.957604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6df0f2182ef4e7b88f5903e6cdfc2dd)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:50.959612 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:50.990874 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.011053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6df0f2182ef4e7b88f5903e6cdfc2dd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.011739 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6df0f2182ef4e7b88f5903e6cdfc2dd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.012361 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6df0f2182ef4e7b88f5903e6cdfc2dd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.020495 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6df0f2182ef4e7b88f5903e6cdfc2dd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.032269 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6df0f2182ef4e7b88f5903e6cdfc2dd'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.044680 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1454/2894] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:50 2022] DELETE /identity/v3/users/c6df0f2182ef4e7b88f5903e6cdfc2dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:51.049219 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.049512 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.049793 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.068762 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:51.070029 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:51.135828 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1441/2895] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:51.148380 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.149876 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:51.220706 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fcfe64-4923-4afa-a26e-2a06a04c8d1e admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.225162 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.225814 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.226096 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.226401 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.236100 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.237546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.247296 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1455/2896] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:51.526471 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.527977 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:51.541568 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5980d-3bc4-4f2c-81b0-da4cbff52798 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.546851 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.547766 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.548047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.548314 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] PATH_INFO: `/v3/projects/6500597befa843e9944ea280f26fb641` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.549565 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6500597befa843e9944ea280f26fb641)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.551531 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.560751 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.600760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6500597befa843e9944ea280f26fb641', 'request_id': 'req-29d6d913-e9a6-4a73-81e2-1b13e84592ae'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.606807 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6500597befa843e9944ea280f26fb641', 'request_id': 'req-29d6d913-e9a6-4a73-81e2-1b13e84592ae'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.612508 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6500597befa843e9944ea280f26fb641', 'request_id': 'req-29d6d913-e9a6-4a73-81e2-1b13e84592ae'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.625753 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] The token cache is being invalidate because project 6500597befa843e9944ea280f26fb641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:51.626044 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.626655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.628330 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1442/2897] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:51 2022] DELETE /identity/v3/projects/6500597befa843e9944ea280f26fb641 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:51.632465 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:51.642792 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261b510-8db6-4cdc-aa3b-c0fb272edea3 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:51.717359 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:51.718244 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:51.718526 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:51.718798 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] PATH_INFO: `/v3/users/c37823e1d8894e5d8e297d1023504712` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:51.720091 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37823e1d8894e5d8e297d1023504712)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:51.722027 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:51.776198 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37823e1d8894e5d8e297d1023504712'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.777034 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37823e1d8894e5d8e297d1023504712'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.777726 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37823e1d8894e5d8e297d1023504712'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.780322 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:51.786589 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37823e1d8894e5d8e297d1023504712'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.799733 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-7b2bdeac-982e-44c5-a0f9-4fca0578b9dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37823e1d8894e5d8e297d1023504712'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:51.812250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1456/2898] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:51 2022] DELETE /identity/v3/users/c37823e1d8894e5d8e297d1023504712 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:52.093911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.095454 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:52.109241 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6d913-e9a6-4a73-81e2-1b13e84592ae admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.171246 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.172057 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.172344 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.172620 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] PATH_INFO: `/v3/projects/b346bdf770ed4d0d86f048bc281e11d5` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.173911 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b346bdf770ed4d0d86f048bc281e11d5)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.175913 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.224473 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b346bdf770ed4d0d86f048bc281e11d5', 'request_id': 'req-6a0c15cb-9f9a-4495-bb22-09f276242f76'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:52.230833 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b346bdf770ed4d0d86f048bc281e11d5', 'request_id': 'req-6a0c15cb-9f9a-4495-bb22-09f276242f76'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:52.237446 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b346bdf770ed4d0d86f048bc281e11d5', 'request_id': 'req-6a0c15cb-9f9a-4495-bb22-09f276242f76'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:52.252479 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] The token cache is being invalidate because project b346bdf770ed4d0d86f048bc281e11d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:52.252770 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:52.253405 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-6a0c15cb-9f9a-4495-bb22-09f276242f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:52.255022 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1443/2899] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:52 2022] DELETE /identity/v3/projects/b346bdf770ed4d0d86f048bc281e11d5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:52.260115 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.260613 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.260976 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.287807 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:52.289051 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:52.353102 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1457/2900] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:52.410066 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.410427 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.410873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.438540 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:52.439705 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:52.449202 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1444/2901] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:52.453588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.463889 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f85587-0bd0-4713-9c7f-1f7e720bd040 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.469820 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.470471 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.470744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.471014 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.471790 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:52.472087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.473689 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.486089 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1458/2902] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:52.490324 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.499822 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb3c50-aa86-40eb-b0b8-9697842be34d None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.505527 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.506182 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.506466 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.506772 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.507563 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.509484 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.531963 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:52.543301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1445/2903] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:52 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:52.544919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.559570 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b10e1-6f4b-43e3-8ceb-af071e01a2bd admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.622654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.623549 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.623891 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.624204 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.624886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.627097 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.650920 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1459/2904] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:52 2022] POST /identity/v3/users => generated 280 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 16:54:52.656308 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.672234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf964-f4a9-4d1b-8391-016719875c97 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.679853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.680823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.681215 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.681618 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.682823 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.685328 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.701020 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1446/2905] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:52.705199 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.715428 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3e3d-6bee-4299-8d76-58222b1c3710 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.721008 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7de197-4764-44f3-8989-ab8defce7f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.721667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de197-4764-44f3-8989-ab8defce7f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.721943 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de197-4764-44f3-8989-ab8defce7f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.722210 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7de197-4764-44f3-8989-ab8defce7f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.722929 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7de197-4764-44f3-8989-ab8defce7f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.724562 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7de197-4764-44f3-8989-ab8defce7f18 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.734951 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1460/2906] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:52.739227 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.750309 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe6bc-b4b2-43c7-89bb-232be6c2912e admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:52.754955 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:52.755873 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.756159 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.756434 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] PATH_INFO: `/v3/projects/f5d33b55f0034fb7a5462cc22351d36c/users/bdc7ca6ea8934f318e62cd6db37572a1/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.771386 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d33b55f0034fb7a5462cc22351d36c, user_id=bdc7ca6ea8934f318e62cd6db37572a1, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:52.774072 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:52.789153 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1447/2907] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:52 2022] PUT /identity/v3/projects/f5d33b55f0034fb7a5462cc22351d36c/users/bdc7ca6ea8934f318e62cd6db37572a1/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:52.800276 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:52.800564 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:52.800839 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:52.828713 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] MFA Rules not processed for user `bdc7ca6ea8934f318e62cd6db37572a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:52.829919 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:52.850355 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:52.898248 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1461/2908] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:52.931500 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:52.933419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.001396 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52f4a-d7d9-44bc-94f9-d05bab10fe15 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.006031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d94210-7cc8-43af-a664-755217e6f41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.006713 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d94210-7cc8-43af-a664-755217e6f41a service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.007008 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d94210-7cc8-43af-a664-755217e6f41a service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.007311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d94210-7cc8-43af-a664-755217e6f41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.017696 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d94210-7cc8-43af-a664-755217e6f41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.019173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d94210-7cc8-43af-a664-755217e6f41a service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.029178 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1448/2909] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:52 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:53.043840 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.112763 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca4df3-1f0b-4bfe-93ae-c7bd34ea24e2 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.118249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.119120 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.119435 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.119710 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] PATH_INFO: `/v3/users/bdc7ca6ea8934f318e62cd6db37572a1` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.121021 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc7ca6ea8934f318e62cd6db37572a1)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.123174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.173026 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc7ca6ea8934f318e62cd6db37572a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.173661 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc7ca6ea8934f318e62cd6db37572a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.174249 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc7ca6ea8934f318e62cd6db37572a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.182841 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc7ca6ea8934f318e62cd6db37572a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.195458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc7ca6ea8934f318e62cd6db37572a1'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.208338 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1462/2910] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:53 2022] DELETE /identity/v3/users/bdc7ca6ea8934f318e62cd6db37572a1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:53.213019 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.213496 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.213581 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.232200 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:53.233406 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.297997 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1449/2911] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:53.308419 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.310048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.357861 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.372429 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a39d7-7f0c-45bf-a5ac-899dd477931d admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.376676 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff3960-6c7b-4a42-a257-252b0db7a053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.377326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3960-6c7b-4a42-a257-252b0db7a053 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.377606 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3960-6c7b-4a42-a257-252b0db7a053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.377880 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3960-6c7b-4a42-a257-252b0db7a053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.387460 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff3960-6c7b-4a42-a257-252b0db7a053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.388904 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff3960-6c7b-4a42-a257-252b0db7a053 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.397986 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1463/2912] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:53.669860 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.671356 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.685092 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeacd64-a183-4743-933a-8768ca128b42 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.691320 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.692477 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.692650 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.692957 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] PATH_INFO: `/v3/projects/f5d33b55f0034fb7a5462cc22351d36c` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.694263 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d33b55f0034fb7a5462cc22351d36c)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.696270 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.748264 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d33b55f0034fb7a5462cc22351d36c', 'request_id': 'req-02e1fc93-495c-46cb-80d1-6a2a20a529b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.756172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d33b55f0034fb7a5462cc22351d36c', 'request_id': 'req-02e1fc93-495c-46cb-80d1-6a2a20a529b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.760903 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:53.762067 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d33b55f0034fb7a5462cc22351d36c', 'request_id': 'req-02e1fc93-495c-46cb-80d1-6a2a20a529b2'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.778216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] The token cache is being invalidate because project f5d33b55f0034fb7a5462cc22351d36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:53.778510 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.779120 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-02e1fc93-495c-46cb-80d1-6a2a20a529b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:53.780754 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1450/2913] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:53 2022] DELETE /identity/v3/projects/f5d33b55f0034fb7a5462cc22351d36c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:53.785742 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.786030 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.786309 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.805064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:53.806201 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.867799 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1464/2914] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:54:53.876384 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.876781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.877065 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.903971 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:53.905175 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:53.914613 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1451/2915] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:53.918910 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.928887 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5173c39-3336-474a-aa66-9213a191cbe8 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.934240 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.934902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.935173 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.935478 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.936202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:53.936509 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.938129 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:53.949788 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1465/2916] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:53.954039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:53.964301 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4e664-5552-4446-a00b-47942511ea42 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:53.970952 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:53.971916 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:53.972342 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:53.972717 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:53.973779 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:53.976914 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.016282 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1452/2917] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:53 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:54.022650 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.034019 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef1006-095a-4785-a465-22a68e6405f8 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.094456 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.095174 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.095477 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.095744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.096467 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.098383 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.122721 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1466/2918] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:54 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:54.129224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.142307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c2f97-6a25-4159-bce1-cfe2a7e627da admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.147964 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.148639 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.148897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.149173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.149900 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.151594 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.163111 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1453/2919] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:54:54.167511 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.178075 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f257ca-13fa-4694-984d-accb3870f2d4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.185227 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee3d2-9842-456f-800a-cc4dc4f6a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.185888 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee3d2-9842-456f-800a-cc4dc4f6a35a admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.186178 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee3d2-9842-456f-800a-cc4dc4f6a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.186453 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee3d2-9842-456f-800a-cc4dc4f6a35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.187194 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee3d2-9842-456f-800a-cc4dc4f6a35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.188858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee3d2-9842-456f-800a-cc4dc4f6a35a admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.199588 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1467/2920] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:54.203897 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.214390 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda0be9-aff5-4488-bbba-be6c1d9c44bd admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.220165 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.221048 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.221331 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.221609 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] PATH_INFO: `/v3/projects/85cb6c4f94d24569a99c6b23a37715a3/users/b02d0c8be38f445f895a1c2697066184/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.237441 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85cb6c4f94d24569a99c6b23a37715a3, user_id=b02d0c8be38f445f895a1c2697066184, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.240155 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.255655 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1454/2921] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:54 2022] PUT /identity/v3/projects/85cb6c4f94d24569a99c6b23a37715a3/users/b02d0c8be38f445f895a1c2697066184/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:54.267239 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.267534 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.267838 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.296884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] MFA Rules not processed for user `b02d0c8be38f445f895a1c2697066184`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:54.298087 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:54.342966 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:54.370667 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1468/2922] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:54.382147 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:54.383893 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:54.441616 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3673f11-1fcc-4619-8715-60428fee14e7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:54.445603 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a85c9-3d12-4ee1-964a-c157c1cad65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:54.446230 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a85c9-3d12-4ee1-964a-c157c1cad65a service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:54.446530 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a85c9-3d12-4ee1-964a-c157c1cad65a service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:54.446805 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a85c9-3d12-4ee1-964a-c157c1cad65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:54.455419 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a85c9-3d12-4ee1-964a-c157c1cad65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:54.456864 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a85c9-3d12-4ee1-964a-c157c1cad65a service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:54.465797 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1455/2923] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:57.035418 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.113202 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5962e-4b1d-406b-833f-ec6e1d382371 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.119260 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.120179 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.120458 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.120744 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] PATH_INFO: `/v3/users/b02d0c8be38f445f895a1c2697066184` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.121952 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b02d0c8be38f445f895a1c2697066184)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.124124 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.176902 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b02d0c8be38f445f895a1c2697066184'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.177561 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b02d0c8be38f445f895a1c2697066184'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.178167 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b02d0c8be38f445f895a1c2697066184'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.188402 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b02d0c8be38f445f895a1c2697066184'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.203559 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b02d0c8be38f445f895a1c2697066184'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.217384 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1469/2924] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:54:57 2022] DELETE /identity/v3/users/b02d0c8be38f445f895a1c2697066184 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:57.222031 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.222514 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.222633 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.240781 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:57.242027 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:57.302181 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1456/2925] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:57.311972 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.313748 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:57.377672 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468e24c-81a8-4bc4-bf27-8f3cfb65e226 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.381924 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9cd03-42b1-4438-88e2-0d8b91a200d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.382573 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cd03-42b1-4438-88e2-0d8b91a200d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.382884 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cd03-42b1-4438-88e2-0d8b91a200d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.383180 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9cd03-42b1-4438-88e2-0d8b91a200d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.393231 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9cd03-42b1-4438-88e2-0d8b91a200d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.394669 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9cd03-42b1-4438-88e2-0d8b91a200d0 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.404132 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1470/2926] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:54:57.682058 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.683794 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:57.697878 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0182b9b-0227-4edd-bd4a-0a2c65e7a510 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.702800 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.704216 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.704532 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.704981 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] PATH_INFO: `/v3/projects/85cb6c4f94d24569a99c6b23a37715a3` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.706261 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85cb6c4f94d24569a99c6b23a37715a3)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.708231 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.733817 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:57.759475 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85cb6c4f94d24569a99c6b23a37715a3', 'request_id': 'req-0daf161e-c241-4959-9726-6713c2190c35'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.765820 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85cb6c4f94d24569a99c6b23a37715a3', 'request_id': 'req-0daf161e-c241-4959-9726-6713c2190c35'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.772145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85cb6c4f94d24569a99c6b23a37715a3', 'request_id': 'req-0daf161e-c241-4959-9726-6713c2190c35'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.787329 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] The token cache is being invalidate because project 85cb6c4f94d24569a99c6b23a37715a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:54:57.787617 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.788311 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-0daf161e-c241-4959-9726-6713c2190c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:54:57.789862 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1457/2927] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:54:57 2022] DELETE /identity/v3/projects/85cb6c4f94d24569a99c6b23a37715a3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:54:57.794901 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.795215 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.795496 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.802099 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:57.816546 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:57.817886 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:57.881250 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1471/2928] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:57.889428 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.889718 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.889994 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.909187 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:57.910383 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:57.919985 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1458/2929] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:57.924069 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.933997 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9175e6-6821-4984-9d61-4bcc986943bb None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.938945 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.939679 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.939979 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.940312 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] PATH_INFO: `/v3/domains` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.941103 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80441) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 16:54:57.941415 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.943048 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:57.955064 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1472/2930] 10.222.0.45 () {58 vars in 1152 bytes} [Wed May 25 16:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 16:54:57.960651 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:57.970236 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6a142-5a7d-46c6-974a-99e4162e91b6 None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:57.978585 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:57.979505 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:57.979788 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:57.980091 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] PATH_INFO: `/v3/projects` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:57.980774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:57.982735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.011223 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1459/2931] 10.222.0.45 () {60 vars in 1152 bytes} [Wed May 25 16:54:57 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:58.015615 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.026551 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288570e-a9e4-47a3-bc33-489d8f388087 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.085896 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.086568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.086850 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.087116 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.087835 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.089815 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.112961 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1473/2932] 10.222.0.45 () {60 vars in 1143 bytes} [Wed May 25 16:54:58 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 16:54:58.117173 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.128126 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90345a9b-60cf-4647-a0a6-16bc8723428d admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.133114 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.133761 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.134039 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.134333 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.135053 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.136774 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.147307 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1460/2933] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 16:54:58.151479 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.162326 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ebb97-e593-490d-addc-5c0c7eb426a4 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.168885 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a112a2a-e729-4a06-a271-447debcd4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.169858 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a112a2a-e729-4a06-a271-447debcd4238 admin admin] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.170159 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a112a2a-e729-4a06-a271-447debcd4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.170474 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a112a2a-e729-4a06-a271-447debcd4238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.171529 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a112a2a-e729-4a06-a271-447debcd4238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.173989 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a112a2a-e729-4a06-a271-447debcd4238 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.189411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1474/2934] 10.222.0.45 () {58 vars in 1121 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 16:54:58.193935 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.209177 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91679b4f-3b00-45c8-8626-540263acf1b7 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.215760 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.216654 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.216944 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.217224 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] PATH_INFO: `/v3/projects/dbd9b94ecf92424b9ff055efbb00d2e6/users/0944dd70bb704e1ea1e55562c4d9a388/roles/4c771a108e9842478e33bd28c8b41844` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.241695 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd9b94ecf92424b9ff055efbb00d2e6, user_id=0944dd70bb704e1ea1e55562c4d9a388, role_id=4c771a108e9842478e33bd28c8b41844)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.245740 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.261612 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1461/2935] 10.222.0.45 () {60 vars in 1482 bytes} [Wed May 25 16:54:58 2022] PUT /identity/v3/projects/dbd9b94ecf92424b9ff055efbb00d2e6/users/0944dd70bb704e1ea1e55562c4d9a388/roles/4c771a108e9842478e33bd28c8b41844 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 16:54:58.273366 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] REQUEST_METHOD: `POST` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.273654 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.273946 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.306382 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.auth.core [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] MFA Rules not processed for user `0944dd70bb704e1ea1e55562c4d9a388`. Rule list: `[]` (Enabled: `True`). {{(pid=80441) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:54:58.307923 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:58.369482 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:54:58.376094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1475/2936] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:54:58.387047 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:54:58.388853 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:54:58.451004 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564bb11-d9a7-416b-9ad3-64a941202fe5 admin admin] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:54:58.455487 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee35e2-114f-45af-b605-b557e868949c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb3714586bf4b50a1a9b29358f92b2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:54:58.456109 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee35e2-114f-45af-b605-b557e868949c service cinder] REQUEST_METHOD: `GET` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:54:58.456430 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee35e2-114f-45af-b605-b557e868949c service cinder] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:54:58.456735 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee35e2-114f-45af-b605-b557e868949c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:54:58.466172 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee35e2-114f-45af-b605-b557e868949c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:54:58.467745 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee35e2-114f-45af-b605-b557e868949c service cinder] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:54:58.477683 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1462/2937] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:55:08.377738 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:08.473915 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:17.942113 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.010800 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cee55a-8159-4bfb-8c54-b77e9838a2d0 None None] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.018697 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.020072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.020390 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.020848 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] PATH_INFO: `/v3/users/0944dd70bb704e1ea1e55562c4d9a388` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.022941 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0944dd70bb704e1ea1e55562c4d9a388)` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.026072 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.078908 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0944dd70bb704e1ea1e55562c4d9a388'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.079717 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0944dd70bb704e1ea1e55562c4d9a388'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.080411 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0944dd70bb704e1ea1e55562c4d9a388'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.089624 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0944dd70bb704e1ea1e55562c4d9a388'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.101539 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.notifications [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0944dd70bb704e1ea1e55562c4d9a388'} {{(pid=80441) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.114053 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1476/2938] 10.222.0.45 () {58 vars in 1223 bytes} [Wed May 25 16:55:17 2022] DELETE /identity/v3/users/0944dd70bb704e1ea1e55562c4d9a388 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:18.118891 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] REQUEST_METHOD: `POST` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.119472 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.119577 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.139302 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.auth.core [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] MFA Rules not processed for user `32f50b0a3d2643cab337d0af8f4d09eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80440) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:55:18.140547 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:18.203145 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1463/2939] 10.222.0.45 () {58 vars in 957 bytes} [Wed May 25 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:55:18.213079 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.214737 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:18.273869 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495efdd-dc73-44de-971c-3e60a6ec65b7 admin admin] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.278855 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99e8bd308e5549618c66d6edaf02523c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.279543 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.279823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.280094 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.291344 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.292823 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.302934 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1477/2940] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:55:18.586460 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] Authenticating user token {{(pid=80440) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:18.588052 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.fernet_utils [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80440) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:18.602129 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd66ba-06ab-428a-a9d6-558a68d5f65b None None] Validating token access rules against request {{(pid=80440) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:18.606831 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32f50b0a3d2643cab337d0af8f4d09eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e50e9a5bbf7f4ed0b472df8cdb0192de', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80440) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:18.608377 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:18.608780 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:18.609234 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] PATH_INFO: `/v3/projects/dbd9b94ecf92424b9ff055efbb00d2e6` {{(pid=80440) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:18.610418 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd9b94ecf92424b9ff055efbb00d2e6)` {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:18.612470 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] RBAC: Authorization granted {{(pid=80440) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:18.662949 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd9b94ecf92424b9ff055efbb00d2e6', 'request_id': 'req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.668961 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd9b94ecf92424b9ff055efbb00d2e6', 'request_id': 'req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.674317 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd9b94ecf92424b9ff055efbb00d2e6', 'request_id': 'req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f'} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.687543 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] The token cache is being invalidate because project dbd9b94ecf92424b9ff055efbb00d2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80440) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:55:18.687825 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.688424 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG keystone.notifications [None req-de5d1a0b-29c4-482a-bd5c-425f77c0cf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80440) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:55:18.689946 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: [pid: 80440|app: 0|req: 1464/2941] 10.222.0.45 () {58 vars in 1232 bytes} [Wed May 25 16:55:18 2022] DELETE /identity/v3/projects/dbd9b94ecf92424b9ff055efbb00d2e6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:55:28.298350 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:28.684842 dv-cinder-843279-2-iscsi devstack@keystone.service[80440]: DEBUG dbcounter [-] [80440] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:55:47.421568 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] Authenticating user token {{(pid=80441) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:55:47.423323 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:47.497604 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868393b6-8091-42f3-8834-c01bf4d00699 service neutron] Validating token access rules against request {{(pid=80441) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:55:47.561520 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59e10be40282478faf3da72169dee4a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fff1cc8be2248d9b0edcc8256952f86', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80441) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:55:47.562163 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] REQUEST_METHOD: `GET` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:55:47.562443 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] SCRIPT_NAME: `/identity` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:55:47.562718 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80441) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:55:47.564641 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.fernet_utils [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80441) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:55:47.576098 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:55:47.577690 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1468420-98b8-4e5d-96fa-9cfad94f695a service placement] RBAC: Authorization granted {{(pid=80441) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:55:47.587883 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: [pid: 80441|app: 0|req: 1478/2942] 10.222.0.45 () {60 vars in 1365 bytes} [Wed May 25 16:55:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:55:57.583834 dv-cinder-843279-2-iscsi devstack@keystone.service[80441]: DEBUG dbcounter [-] [80441] Writing DB stats keystone:SELECT=58 {{(pid=80441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}